Install miniconda2 by sourcing install_miniconda.sh in your home directory. Log out and log back in after this.
cp install_miniconda.sh ~/
cd ~
source install_miniconda.shInstall the rest of the dependencies:
cd ~/keras-training
source install.shEach time you log in set things up:
source setup.shAll of the data ntuple files are available here: https://cernbox.cern.ch/index.php/s/AgzB93y3ac0yuId
To add the truth values and flatten the trees (you can skip this step)
cd ~/keras-training/convert
python addTruth.py -t t_allpar \
../data/processed-pythia82-lhc13-*-pt1-50k-r1_h022_e0175_t220_nonu.rootTo hadd these files and convert from TTree to numpy array with
random shuffling (you can skip this step)
hadd -f \
../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.root \
../data/processed-pythia82-lhc13-*-pt1-50k-r1_h022_e0175_t220_nonu_truth.root
python convert.py -t t_allpar_new \
../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.rootYou can also copy this file directly from: https://cernbox.cern.ch/index.php/s/jvFd5MoWhGs1l5v
To run a simple training:
cd ~/keras-training/train
python train.py -t t_allpar_new \
-i ../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.z \
-c train_config_threelayer.yml \
-o train_simple/and evaluate the training:
python eval.py -t t_allpar_new \
-i ../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.z \
-m train_simple/KERAS_check_best_model.h5 \
-c train_config_threelayer.yml \
-o eval_simple/To prune the trained model by removing weights below a certain threshold (relative weight < 0.2):
mkdir prune_simple_relwmax2e-1
python prune.py -m train_simple/KERAS_check_best_model.h5 \
--relative-weight-max 2e-1 \
-o prune_simple_relwmax2e-1/pruned_model.h5and evaluate the pruned model:
python eval.py -t t_allpar_new \
-i ../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.z \
-m prune_simple_relwmax2e-1/pruned_model.h5 \
-c train_config_threelayer.yml \
-o eval_simple_relwmax2e-1/To retrain the pruned model (keeping the pruned weights fixed to 0):
python retrain.py -t t_allpar_new \
-i ../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.z \
-o retrain_simple_relwmax2e-1 \
-m prune_simple_relwmax2e-1/pruned_model.h5 \
-c train_config_threelayer.yml \
-d prune_simple_relwmax2e-1/pruned_model_drop_weights.h5and evaluate the pruned, retrained model:
python eval.py -t t_allpar_new \
-i ../data/processed-pythia82-lhc13-all-pt1-50k-r1_h022_e0175_t220_nonu_truth.z \
-m retrain_simple_relwmax2e-1/KERAS_check_best_model.h5 \
-c train_config_threelayer.yml \
-o eval_retrain_simple_relwmax2e-1/