This repository has my pipeline for training neural nets.

Main frameworks used:

• hydra
• pytorch-lightning

The main ideas of the pipeline:

• all parameters and modules are defined in configs;
• prepare configs beforehand for different optimizers/schedulers and so on, so it is easy to switch between them;
• have templates for different deep learning tasks. Currently image classification and named entity recognition are supported;

Examples of running the pipeline: This will run training on MNIST (data will be downloaded):

>>> python train.py --config-name mnist_config model.encoder.params.to_one_channel=True

The default run:

>>> python train.py

The default version of the pipeline is run on imagenette dataset. To do it downdload the data from this repository: https://github.com/fastai/imagenette unzip it and define path to it in conf/datamodule/image_classification.yaml path