ARCHIVED - no longer being run
Scraper designed to fetch datasets from UNOSAT's Flood Portal and create equivalent datasets on HDX. The resulting datasets, results, and gallery items are created automatically on the Humanitarian Data Exchange's website.
Clone this repository, navigate to the repository's directory, and run:
$ make setup && make test
$ make run
Make sure you edit the config files in the config/
folder if you are interested in having the scripts interact with HDX instances.
This collector makes use of a Makefile
to run a series of pre-determined shell scripts. The structure of the Makefile
is presented as follows. Simply run make
alongside one of the instructions (e.g. make setup
).
test:
bash bin/test.sh;
setup:
bash bin/setup.sh;
setupsw:
bash bin/setup_sw.sh;
run:
bash bin/run.sh;