evalutils helps challenge administrators easily create evaluation containers for grand-challenge.org.

• Free software: MIT license
• Documentation: https://evalutils.readthedocs.io.

• Generation your challenge evaluation project boilerplate using Cookiecutter
• Scripts to build, test and export your generated docker container for grand-challenge.org
• Loading of CSV, ITK and Pillow compatible prediction files
• Validation of submitted predictions
• Interface to SciKit-Learn metrics and Pandas aggregations
• Bounding box annotations with Intersection Over Union calculations

evalutils requires Python 3.6, and can be installed from pip. Please see the Getting Started documentation for more details.

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.