HXLStandard / hxl-spider Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Simple spider to crawl HXL datasets on the Humanitarian Data Exchange and report stats.

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
.gitignore		.gitignore
README.md		README.md
config.py.TEMPLATE		config.py.TEMPLATE
crawl-hxl.py		crawl-hxl.py

Repository files navigation

Script to crawl HXL datasets on HDX and collect statistics

Prerequisites

Python3
the ckanapi module
the libhxl module
an account on a CKAN instance

Instructions

Copy the file config.py.TEMPLATE to config.py and fill in the fields
Execute the command python3 crawl-hxl.py

About

Simple spider to crawl HXL datasets on the Humanitarian Data Exchange and report stats.

Custom properties

Report repository

Releases

No releases published

Packages

No packages published

Languages

Python 100.0%