Helper functions for text classification with BERT.

This code requires Python 3.7 venv and pip.

To install, run ./run install.

Optional: Install GPU support with ./run pip install tensorflow-gpu==1.15.0.

Read data and standardize the format with ./run python prepare.py DATA_ID

Multiple labels are split, sorted and represented with one-hot encoding. The processed data is stored as .pkl file.

The code is yapf / mypy / flake8 linted.

To run the linter, ./run lint.

To format all files, ./run format.

This package uses MyPy for Python type checking and intellisense.

To install mypy in vscode, install the 'mypy' plugin and run these:

sudo apt install python3.8-venv python3.8-dev
python3.8 -m venv ~/.mypyls
~/.mypyls/bin/pip install -U wheel
~/.mypyls/bin/pip install -U "https://github.com/matangover/mypyls/archive/master.zip#egg=mypyls[patched-mypy]"