This test suite automates Sailfish SDK testing with the help of Robot Framework.

• http://robotframework.org/

1. Install Robot Framework with Python PIP:

   pip3 install --user robotframework

This will install the Robot Framework executables under ~/.local/bin/. The rest of this guide assumes those executables are available in PATH.

TBD

TBD

After cloning the Git repository containing this test suite, ensure that all submodules are populated and up to date:

git submodule update --init --recursive

Create a working directory for this test run, enter it and configure the test suite - point it to the installer executable and optionally pass initial arguments for the installer (run configure with --help to learn about available options):

repo=file:///path/to/local/repo
mkdir sdk-test-suite.out && cd sdk-test-suite.out
../path/to/sdk-test-suite/configure ../path/to/SailfishSDK-1.2.3-offline.run \
    --addRepository "$repo/commmon/,$repo/linux-64/"

Run the test suite:

robot ../path/to/sdk-test-suite

Open test report:

xdg-open report.html

interactive

User interaction is required during test case execution

needs-gui

Headless execution of a test case is not possible

• https://github.com/nokia/RED

Install inside Eclipse via Help > Eclipse Marketplace..., seach for RED.

Unfortunately, when RED validates the test suite, it does it in a way that it requires that the configuration file exists under the source directory. This can be partially worked around with a symlink after configuration is done under a separate output directory:

cd sdk-test-suite
ln -s ../path/to/sdk-test-suite.out/config.py .