Libraries for loadtesting CommCare HQ's new form and case processing/retore engine.

This repository mainly consists of two components:

• A prototype endpoint (with swappable backends) for processing forms and cases and restoring data to phones
• A suite of load testing tools (including tests of the prototype) built on tsung.

These tests depend on Postgres 9.4 since they make use of the jsonb column type. They also depend on Redis 2.6 or later .

See [http://www.postgresql.org/docs/9.4/static/upgrading.html] for information about upgrading your local postgres.

To upgrade redis you can just install a new version over your existing one.

To setup an environment for the prototype make a new virtualenv and install requirements:

$ makevirtualenv --no-site-packages mobile-endpoint
$ cd prototype/
$ pip install -r requirements.txt  # different from tsung requirements

In the prototype directory first setup a localconfig.py and testconfig.py and edit the connection string (and anything else as necessary). localconfig.py just needs to exist (and will be used for running the server). testconfig.py overrides localconfig.py when running tests.

$ cp localconfig.example.py localconfig.py
$ cp testconfig.example.py testconfig.py

Once your settings are updated you can run tests as follows

$ py.test  # run all tests
$ py.test -k test_models  # run model tests
$ py.test -k test_basic  # run test_models.test_basic
$ py.test -m <sql or couch> # only run the sql or couch tests
$ py.test --rowsize <form or case> # run the rowsize form or case tests

$ sudo git clone https://github.com/processone/tsung.git /usr/local/src/tsung
$ cd /usr/local/src/tsung
$ ./configure
$ sudo make install

• autoconf
• automake
• erlang-base
• erlang-crypto
• erlang-eunit
• erlang-inets
• erlang-snmp
• erlang-ssl
• erlang-xmerl
• erlang-dev
• erlang-asn1

• give commcarehq user access to all postgresql databases
• create pgpass file in cchq home so we don't need to handle password input
• increase max connections in pgbouncer

Use the awesome_test task to run the tests. e.g.

$ sudo -iu cchq bash
$ source ~/.virtualenvs/tsung/bin/activate
$ pip install -r requirements.txt  # Only necessary if there are new deps
$ ulimit -n 65536  # Make sure enough file descriptors are available
$ invoke awesome_test --duration=60 --load=100 --backend=prototype --user-rate=250

The load flag is optional. If not included, no new forms or cases will be loaded into the database before running the test.

To load the database you can use:

$ invoke load_db <scale_factor> <backend>