| 翻訳と辞書 |
Scrapy
Scrapy ( )〔( How do you pronounce "Scrapy"? )〕 is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.〔(Scrapy at a glance )〕 It is currently maintained by Scrapinghub Ltd., a web scraping development and services company.
Scrapy project architecture is built around ‘spiders’, which are self-contained crawlers which are given a set of instructions. Following the spirit of other don’t repeat yourself frameworks, such as Django,〔(【引用サイトリンク】 title= Frequently Asked Questions )〕 it makes it easier to build and scale large crawling projects by allowing developers to re-use their code. Scrapy also provides a web crawling shell which can be used by developers to test their assumptions on a site’s behavior.〔(【引用サイトリンク】 Scrapy shell )〕
Some well-known companies and products using Scrapy are: Lyst, CareerBuilder,〔(Scrapy | Companies using Scrapy )〕 Parse.ly,〔(【引用サイトリンク】 title=Web Crawling & Metadata Extraction in Python )〕 Sciences Po Medialab,〔(Hyphe v0.0.0 : the first release of our new webcrawler is out ! )〕 Data.gov.uk’s World Government Data site.
==History==
Scrapy was born at London-based web aggregation and e-commerce company Mydeco, where it was developed and maintained by employees of Mydeco and Insophia (a web consulting company based in Montevideo, Uruguay). The first public release was in August 2008 under the BSD license, with a milestone 1.0 release happening in June 2015. In 2011, Scrapinghub became the new official maintainer.
抄文引用元・出典: フリー百科事典『 ウィキペディア（Wikipedia）』
■ウィキペディアで「Scrapy」の詳細全文を読む
スポンサード リンク
| 翻訳と辞書 : 翻訳のためのインターネットリソース |
Copyright(C) kotoba.ne.jp 1997-2016. All Rights Reserved.
|
|