Skip to content

colombian/tarea1_dataAcquisitionAndPrep

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

The results are saved in usagov_scrapping/tarea1.json

Requirements:
python3
pipenv
scrapy

comands to run:
$ cd usagov_scrapping/
$ pipenv shell
$ scrapy crawl datasets

About

Exercice on scrapy for web crawling the first 3 pages of https://catalog.data.gov/dataset

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages