Scrapy project

Pinned Loading

1. scrapy scrapy Public

   Scrapy, a fast high-level web crawling & scraping framework for Python.

   Python 64.6k 12k

2. scrapyd scrapyd Public

   A service daemon to run Scrapy spiders

   Python 3.1k 581

3. parsel parsel Public

   Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

   Python 1.4k 175

4. w3lib w3lib Public

   Python library of web-related functions

   HTML 419 129

5. protego protego Public

   A pure-Python robots.txt parser with support for modern conventions.

   DIGITAL Command Language 94 35

6. itemadapter itemadapter Public

   Common interface for data container classes

   Python 69 19