This repository contains the tools and the data of the paper "Model-based Exploration of the Frontier of Behaviours for Deep Learning System Testing" by V. Riccio and P. Tonella, to be published in the Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020).

The package is structured as follows:

• DeepJanus-MNIST contains the DeepJanus tool adapted to the handwritten digit classification case study and the instructions on how to use it;
• DeepJanus-BNG contains the DeepJanus tool adapted to the self-driving car case study and the instructions on how to use it;
• experiments contains the raw experimental data reported in the paper and the scripts to obtain the data.

Note: each sub-package contains further specific instructions.

If you use our work in your research, or it helps it, or if you simply like it, please cite DeepJanus in your publications. Here is an example BibTeX entry:

@inproceedings{RiccioTonella_FSE_2020,
	title= {Model-based Exploration of the Frontier of Behaviours for Deep Learning System Testing},
	author= {Vincenzo Riccio and Paolo Tonella},
	booktitle= {Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering},
	series= {ESEC/FSE '20},
	publisher= {Association for Computing Machinery},
	doi = {10.1145/3368089.3409730},
	pages= {13 pages},
	year= {2020}
}

The software we developed is distributed under MIT license. See the LICENSE.md file.

For any related question, please contact Vincenzo Riccio (vincenzo.riccio@usi.ch) or Paolo Tonella (paolo.tonella@usi.ch).