CI | Branch | Build Status | Coverage |
---|---|---|---|
Docker | master | ||
Travis | master | ||
Travis | develop |
This repository documents code used to gather, QC, standardize, and analyze data uploaded by centers participating in the VEO-IBD consortium.
These are tools or packages you will need, to be able to reproduce these results:
- Python 3.5 or higher
pip install git+https://github.com/veo-ibd/genie.git
This will install all the necessary components for you to run the validator locally on all of your files, including the Synapse client. Please view the help to see how to run to validator.
genie validate -h
- Update the version in genie/version.py based on semantic versioning. Use the suffix
-dev
for development branch versions. - When releasing, remove the
-dev
from the version. - Add a tag and release named the same as the version.
- Check docker hub builds to see if theres any failures
- Log into AWS Batch
- Run
genie-job-mainprocess
- Run
genie-job-mafprocess
(Make sure to add--createdMafDatabase
flag) - Run
genie-job-vcfprocess
- Run
genie-job-release
(Make sure to update release version and number)
- Input to database:
input_to_database.py -h
- Create Files
-
release 4.1-consortium and 4.0-public
python database_to_staging.py Jan-2018 ~/cbioportal/ 4.1-consortium --skipMutationsInCis python consortium_to_public.py Jul-2018 ~/cbioportal/ 4.0-public
-
release 5.1-consortium and 5.0-public
python database_to_staging.py Jul-2018 ~/cbioportal/ 5.1-consortium python consortium_to_public.py Jan-2019 ~/cbioportal/ 5.0-public
-
Build an AMI that can run batch jobs! Start from this page and follow instructions and specify your docker image. It is important at this stage that you time the building of your AMI, or your AMI will not be able to start batch jobs. After doing so, you will have to start an instance with the AMI and run these 2 commands:
sudo stop ecs sudo rm -rf /var/lib/ecs/data/ecs_agent_data.json
-
Rebuild the AMI above, specify the size of the image and put whatever you want in the instance that you would want to bind
- Invite users to VEO-IBD participant Team
- Creates CENTER (input/staging) folder (Set up ACLs)
- Update Center Mapping table https://www.synapse.org/#!Synapse:syn10061452/tables/
- Add center to distribution tables: https://www.synapse.org/#!Synapse:syn10627220/tables/, https://www.synapse.org/#!Synapse:syn7268822/tables/
- Add users to their VEO-IBD folder