a scrapyrt API to retrieve data from voyages-sncf.mobi website
$ mkvirtualenv sncflolapi
$ workon sncflolapi
$ pip install -r requirements.txt
If you run into problems with the cryptography package on a osx machine, run this:
$ brew install pkg-config libffi openssl
$ env LDFLAGS="-L$(brew --prefix openssl)/lib" CFLAGS="-I$(brew --prefix openssl)/include" pip install cryptography
(cf this SO thread)
if you want livereload, run pip install watchdog and then :
$ workon sncflolapi
$ ./bin/run_local_server
Useful for debugging, especially to use the inspect_response helper.
$ cd voyagessncf
$ scrapy crawl voyagessncf_mobi -a departure_city=paris -a arrival_city=avignon -a departure_date="01/04/2016" -a departure_hour="18h"
or
$ scrapy crawl voyagessncf_com -a departure_city=paris -a arrival_city=avignon -a departure_date="10/03/2017" -a departure_hour="8"
$ brew install httpie
$ http "http://localhost:9080/crawl.json" departure_city==marseille arrival_city==paris departure_date=="22/03/2017" card==TGVMAX precise_departure_time=="06h11" price_below==80
or with raw curl :
$ curl "http://localhost:9080/crawl.json?departure_date=11%2F03%2F2017&departure_city=paris&arrival_city=rennes&departure_hour=8&card=TGVMAX"