Skip to content
This repository has been archived by the owner on Jan 13, 2019. It is now read-only.

xtream1101/scrape-xkcd

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

26 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrape-xkcd

Developed using Python 3.4

Must pass in a config file like so: python3 xkcd-comics.py -c ~/scrapers.conf

See what the conf file need to be here: https://github.com/xtream1101/scraper-lib

Setup

Run pip3 install -r requirements.txt

Comics

Scrape the site http://xkcd.com/ and save all the comics on the site and get new ones on each run.

This scraper also requires the section in the config:

[xkcd-comics]
# `scraper_key` is only needed if `scraper-monitor` is enabled
scraper_key =

What If

Scrape the site http://what-if.xkcd.com/ and save all the What if's on the site and get new ones on each run.

Needs phantomjs installed on the computer that is running the scraper.

This scraper also requires the section in the config:

[xkcd-whatif]
# `scraper_key` is only needed if `scraper-monitor` is enabled
scraper_key =

About

Scrape and download all the xkcd comics and keep up to date with new ones

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages