The Tester plugin is a tool to help test QGIS core and plugins' functionality. It allows to run automatic and semi-automated tests. The first runs without the tester intervention. The second also includes step-by-step instructions to perform manual or verification tasks.
This plugin was originally developed by Victor Olaya at Boundless.
Documentation can be found here