Skip to content
This repository has been archived by the owner on Dec 23, 2021. It is now read-only.

OCHA-DAP/hdx-scraper-unosat-flood-portal

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

UNOSAT Flood Portal Scraper

ARCHIVED - no longer being run

Scraper designed to fetch datasets from UNOSAT's Flood Portal and create equivalent datasets on HDX. The resulting datasets, results, and gallery items are created automatically on the Humanitarian Data Exchange's website.

Build Status Coverage Status

Setup, Test, and Run

Clone this repository, navigate to the repository's directory, and run:

$ make setup && make test
$ make run

Make sure you edit the config files in the config/ folder if you are interested in having the scripts interact with HDX instances.

Makefile Structure

This collector makes use of a Makefile to run a series of pre-determined shell scripts. The structure of the Makefile is presented as follows. Simply run make alongside one of the instructions (e.g. make setup).

test:
    bash bin/test.sh;

setup:
    bash bin/setup.sh;

setupsw:
    bash bin/setup_sw.sh;

run:
    bash bin/run.sh;