The challenges are here.

All data are from the Titanic disaster (it reminds you Kaggle ?)

Scrapy works only with Python 2.7.

Please install Python 2.7, and not Python 3.x!

On Ubuntu 16:

sudo apt-get install python-dev python-pip libssl-dev libxml2-dev libxslt1-dev libffi-dev

On Windows:

Download and install Anaconda Distribution for Python 2.7.

On Mac OS X:

brew install python

sudo pip install scrapy scrapoxy shub

git clone https://github.com/fabienvauchelles/scraping-challenge-workshop.git
cd scraping-challenge-workshop

Scraper code is inside the file myscraper/spiders/myscraper.py.

Items are inside the file myscraper/items.py.

cd scraping-challenge-workshop
scrapy crawl myscraper -t jsonlines -o persons.json

Exports items are inside the file persons.json.

See the Licence.