Scrapydd is a system for scrapy spiders distributed running and scheduleing system, including server and client agent.

By pip:

pip install scrapydd

You can also install scrapydd manually:

1. Download compressed package from github releases.
2. Decompress the package
3. Run python setup.py install

The docs is hosted here