Skip to content

ynrng/quotesbot

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

QuotesBot

Get my douban collect list data.

Folders

  • data: store data
  • helper: utils
  • mock: localized website data for debug use.
  • quotesbot: crawlers

Extracted data

Data first saved in JSON then in sqlite database.

To restort the database, execute create_db.py in data folder:

Useful commands

# list all the scrapy available
scrapy list 

# execute and output
scrapy crawl toscrape-css -o quotes.json

Useful links

Scrapy Tutorial

About

This is a sample Scrapy project for educational purposes

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%