This project includes model database, model profilers, and model dashboard used in ANT framework.

The model database provides DNN models for various range of IoT devices.

Model database records compressed DNN models.

Kernel database tunes kernel codes of those compressed models and collects them.

• Usage

python modeldb_sender.py --table <model_db_table_name> --path <directory_to_record> [--save_as_csv]

Model profiler can measure latency using programs in latency-predictor, which implemented based on TVM.

This project is implemented based on TVM

• TVM https://github.com/apache/incubator-tvm

• llvm Download Page
• CUDNN Download Page
• CUDA

Model dashboard is a web page that shows available compressed model in model database and kernel code in kernel database. This dashboard web server is implemented based on Flask.

• Usage

python dashboard-run.py 

ANT-Model-DB is open source software under the Apache 2.0 license.