Application for data mapping and import from other databases
On some occasions, data teams will want to import external data sets into OCCAMS. This tool will facilitate the pipelines necessary to continuously integrate external data into a "master" OCCAMS installation.
Some goals of this product:
- PID translation
- External codebook parsing
- Schema mapping
- External data upload
- Python 2.7+
- npm
- lessc (must be installed globally, i.e. with "-g" option)
- redis
- PostgreSQL 9.3+
Because many organizations have their politics of authentication, this app tries to not force any authentication paradigm on the client and instead uses repoze.who to allow clients to supply their own authentication via customized-organization-specific plugins.
Add as an occams plugin via:
occams.apps = occams_imports
Ensure you've installed the app with the [test] setting and run:
py.test --db=postgresql://USER:PASS@/yourtestdb --cov occams_imports tests/
Run:
sphinx-build -b html docs/source docs/build
And then using a lightweight serving application such as NPM's serve:
serve -p 8080 docs/build