The experimentDB is a web-based application for the storage, organization and communication of experimental data with a focus on molecular biology and biochemical data. This application also stores data regarding reagents, including antibodies, constructs and other biomolecules as well as tracks the distribution of reagents. There is also some preliminary interfaces to other web resources.
This project contains several sub-applications as described below:
This package defines experiments and the related data associated with them. The Experiment model is the focus of this entire project. It contains details about protocols, notes, reagents and project details. Results are associated with Experiment objects allowing for an Experiment to contain several results.
The intent of this app is to co-ordinate specific projects. Projects are intended to be large, grant-sized larger projects in the laboratory. Subprojects are intended to be smaller, potentially paper sized groups of experiments. An experiment can be part of one, none or several projects or subprojects.
The cloning app defines the parameters for the synthesis and maintenance of constructs generated as part of an experiment. Constructs can be generated via either cloning or mutagenesis and will result in a Cloning or Mutagenesis object respectively.
The proteins referenced by this application may be targets of an experiment or reagent. This app also contains more detailed information about specific proteins, normally as accessed from public databases using either external databases or through Biopython tools.
The reagents app stores information about all tools used in research, most of which are defined by a particular Experiment object. These include Primer, Cell (cell lines), Antibody, Strain, Chemical and Construct objects. These models are abstract base classes of a superclass ReagentInfo which defines most of the common relevant information.
The idea is to attribute particular models with references regarding external contacts or vendors or to link in specific references important to the experiments or projects.
The datasets app contains data and views for some external databases. This may include external databases accessed directly or with a mirrored internal database. This module is fairly research-interest specific and will likely be removed eventually.
ExperimentDB requires both a database and a webserver to be set up. Ideally, the database should be hosted separately from the webserver and ExperimentDB installation, but this is not necessary, as both can be used from the same server. If you are using a remote server for the database, it is best to set up a user for this database that can only be accessed from the webserver. If you want to set up several installations (ie for different users or different laboratories), you need separate databases and ExperimentDB installations for each. You will also need to set up the webserver with different addresses for each installation.
- ExperimentDB source code. Download from one of the following:
- http://github.com/davebridges/ExperimentDB/downloads for the current release
- http://github.com/davebridges/ExperimentDB for the source code
from pypi by entering:
pip install experimentdb
Downloading and/or unzipping will create a directory named ExperimentDB. You can update to the newest revision at any time either using git or downloading and re-installing the newer version. Changing or updating software versions will not alter any saved data, but you will have to update the localsettings.py file (described below).
- Python. Requires Version 2.6, is not yet compatible with Python 3.0. Download from Python.
- Django. Download from Django. This will be automatically installed if you installed experimentdb with pip. This will be automatically installed if you installed experimentdb with pip.
- Database software. Typically MySQL is used, but PostgreSQL, Oracle or SQLite can also be used. You also need to install the python driver for this database (unless you are using SQLite, which is internal to Python 2.5+). For more information see Instructions.
- Biopython Packages. Download and install from Biopython. This will be automatically installed if you installed experimentdb with pip.
- South. Install using pip (pip install south). This will be automatically installed if you installed experimentdb with pip.
- Django Ajax Select. Install using pip (pip install django-ajax-selects). This will be automatically installed if you installed experimentdb with pip.
- Python Imaging Library. Install using pip (pip install pil). Available at PIL. This will be automatically installed if you installed experimentdb with pip.
- Create a new database. You need to record the user, password, host and database name. Refer to the database documentation for how to do this with a specific database engine. If you are using SQLite3, you only need to set the engine and the database name. It is recommended to use MySQL.
Go to localsettings_empty.py and edit the settings:
ENGINE: 'mysql', 'postgresql_psycopg2' or 'sqlite3 depending on the database software used. NAME: database name USER: database user. Unless using sqlite3 PASSWORD: database password. Unless using sqlite3 HOST: database host.
- Save this file as localsettings.py in the main ExperimentDB directory.
Run the test client by going into the experimentdb directory and running the following. There should be no errors at this point:
python manage.py test
Generate the initial database tables by entering:
python manage.py syncdb
- When asked generate an administrative superuser and set the email and password.
You need to set up a server to serve both the django installation and saved files. For the saved files. I recommend using apache for both. The preferred setup is to use Apache2 with mod_wsgi. The following is a httpd.conf example where the code is placed in /usr/src/django/experimentdb:
Alias /static /usr/src/django/experimentdb/media
Alias /media /usr/src/django/experimentdb/media
<Directory /usr/src/django/experimentdb/media>
Order allow,deny
Allow from all
</Directory>
WSGIScriptAlias /experimentdb /usr/src/django/experimentdb/apache/django.wsgi
<Directory /usr/src/django/experimentdb/apache>
Order deny,allow
Allow from all
</Directory>
If you want to restrict access to these files, change the Allow from all directive to specific domains or ip addresses (for example Allow from 192.168.0.0/99 would allow from 192.168.0.0 to 192.168.0.99)
Go to experimentdb/admin/auth/users/ and create users, selecting usernames, full names, password (or have the user set the password) and then choose group permissions.
ExperimentDB upgrades may involve schema changes. We use south to control schema migrations. To update database schema, first initial migrations must be run, shortly after installation. If an upgrade (either via SVN or by a new download) involves a change in the database schema, errors may occur. Look at HISTORY in the root folder to see if an upgrade invovles schema migrations. To set up south, shortly after installation enter at the command line:
python manage.py schemamigration data --initial
python manage.py schemamigration datasets --initial
python manage.py schemamigration reagents --initial
python manage.py schemamigration cloning --initial
python manage.py schemamigration sharing --initial
python manage.py schemamigration projects --initial
python manage.py schemamigration external --initial
python manage.py schemamigration proteins --initial
python manage.py schemamigration hypotheses --initial
python manage.py migrate --fake
This will install the initial migration settings. If an app is migrated during an upgrade enter the following where "APP" is data, datasets, reagents, cloning, sharing, projects, external, proteins or hypotheses without the quotes and the "OPTIONAL DESCRIPTION" is something describing the changes, if desired:
python manage.py schemamigration "APP" "OPTIONAL DESCRIPTION" --auto
python manage.py migrate
See the South documentation, or submit an issue if problems occur.