Simple Scrapy app to extract products info:
Required fields:
- Product Name
- Brand
- Category
- Image links
- Price
- Sale Price
- Create virtual enviroment
python3 -m venv directory
- Activate it
source directory/bin/active
- Install requirements
pip3 install -r requirements.txt
- Run scraper
scrapy crawl tuchuzy -o output.json
- Enjoy!
To change the number of scraped items, change the CLOSESPIDER_ITEMCOUNT
in settings.py
and LIMIT
in pipelines.py
with desired number