Python library to harvest, map and upload research community specific metadata into B2FIND CKAN portal. Currently, supported generic metadata schemas are DublinCore, DataCite, DDI2.5, ISO 19139 and EUDAT Core.
Create conda env:
$ conda env create -f environment.yml
$ conda activate b2f
Install mdingestion:
$ python setup.py develop
List available communities:
$ b2f list
Harvest:
$ b2f harvest -c darus
Files are written to oaidata/darus/raw.
Map:
$ b2f map -c darus
Files are written to oaidata/darus/ckan.
Check the validation result:
$ less summary/darus/2020-10-16_darus_summary.json
Upload:
$ b2f upload -c darus -i CKAN_HOST --auth AUTH_KEY
Combine
$ b2f combine -c darus --clean -i CKAN_HOST --auth AUTH_KEY
Purge
$ b2f purge -c darus -i CKAN_HOST --auth AUTH_KEY
Search
$ b2f search --pattern "ice caps" --limit 20
$ b2f search -c darus -i CKAN_HOST
Install pytest:
$ conda install pytest
Run all tests:
$ pytest tests/
Run single test:
$ pytest tests/community/test_darus.py
Update PRODUCTIVE=True and DATE='whatever' in Community mapfiles
b2f list -p -o b2flist.csv