Skip to content

honcharenko-roman/urge-python-test-task

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Tuchuzy Scraper

Simple Scrapy app to extract products info:

Required fields:

  • Product Name
  • Brand
  • Category
  • Image links
  • Price
  • Sale Price

Installation:

  1. Create virtual enviroment

    python3 -m venv directory

  2. Activate it

    source directory/bin/active

  3. Install requirements

    pip3 install -r requirements.txt

  4. Run scraper

    scrapy crawl tuchuzy -o output.json

  5. Enjoy!

To change the number of scraped items, change the CLOSESPIDER_ITEMCOUNT in settings.py and LIMIT in pipelines.py with desired number

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages