This library is deprecated and unmaintained.
Some of its components were moved to their own package:
| Old location | New location |
|---|---|
| scrapylib.crawlera | scrapy-crawlera |
| scrapylib.deltafetch | scrapy-deltafetch |
| scrapylib.hcf | scrapy-hcf |
| scrapylib.magicfields | scrapy-magicfields |
| scrapylib.querycleaner | scrapy-querycleaner |
| scrapylib.splitvariants | scrapy-splitvariants |
Remaining code in this repo:
- Processors: Some additional itemloaders.processors
- ConstraintsPipeline
- GUIDPipeline
- SpiderFieldPipeline
- SelectiveProxyMiddleware
- SpiderTraceMiddleware
- RedisQueue