Skip to content

olddaos/ShopScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commits
 
 
 
 
 
 

Repository files navigation

Shopping crawler

Uses Scrapy to crawl pictures from major russian online stores ( like Azbuka Vkusa ).

Also in plans:

  • Use xdotool to scrape Flash-based stores
  • Use human emulation to crack scraping protection

Usage

Example Usage scrapy crawl azbuka_vkusa

Requirements

  • Scrapy
  • Urllib2

(may have to be independently installed)

Installation

#. git clone ShopScraper

About

Freelance project: uses Scrapy to crawl major Russian shops like 'Azbuka Vkusa' or 'Seveth Continent'

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published