Skip to content

zonca/jwst

 
 

Repository files navigation

JWST Calibration Pipeline

Documentation Status Build Status Powered by STScI Badge Powered by Astropy Badge

STScI Logo

Note

Beginning with version 0.9.0, JWST requires Python 3.5 or above.

Installing

Installing a release version

To install a particular released version of the package, and all dependencies, we recommend using conda and a spec file that lists the exact versions of all packages to be installed. To create a new environment, use:

conda create -n jwst --file <URL>
source activate jwst

where <URL> is of the form:

Linux: http://ssb.stsci.edu/releases/jwstdp/0.12.2/latest-linux
OS X: http://ssb.stsci.edu/releases/jwstdp/0.12.2/latest-osx

Other particular versions can be installed by choosing a different version tag in place of "0.12.2" in the URL path. See the "Software vs DMS build version map" table below for a list of tags corresponding to particular releases.

To update to the latest nightly build:

conda update -n jwst --override-channels -c http://ssb.stsci.edu/astroconda-dev -c defaults --all

Installing the latest development version

To install the development version of the repository, we recommend creating a new environment, using the astroconda channel to install the dependencies, and then installing from the github repository:

conda create -n jwst_dev --only-deps --override-channels -c http://ssb.stsci.edu/astroconda-dev -c defaults python=3.6 jwst
source activate jwst_dev
git clone https://github.com/spacetelescope/jwst.git
cd jwst
python setup.py develop

Once installed, the software can be updated to the lastest development version by updating the dependencies, pulling the latest version of master from the Github repository inside the jwst directory:

conda update -n jwst_dev --override-channels -c http://ssb.stsci.edu/astroconda-dev -c defaults --all
git pull origin master
python setup.py develop

CRDS Setup

Inside the STScI network, the pipeline works with default CRDS setup with no modifications. To run the pipeline outside the STScI network, CRDS must be configured by setting two environment variables:

export CRDS_PATH=$HOME/crds_cache
export CRDS_SERVER_URL=https://jwst-crds.stsci.edu

Documentation

Documentation (built daily from master) is available here:

https://jwst-pipeline.readthedocs.io/en/latest/

One can clone this repository and build the documentation with

pip install sphinx_rtd_theme stsci_rtd_theme sphinx_automodapi
python setup.py build_sphinx

Contributions and Feedback

We welcome contributions and feedback on the project. Please follow the contributing guidelines to submit an issue or a pull request.

We strive to provide a welcoming community to all of our users by abiding to the Code of Conduct.

If you have questions or concerns regarding the software, please open an issue at https://github.com/spacetelescope/jwst/issues or contact the JWST Help Desk.

Software vs DMS build version map

jwst tag DMS build CRDS_CONTEXT Date Notes
0.12.3 B7.2.1 0500 01/15/2019 DMS Build 7.2.1 patch release
0.12.2 B7.2 0495 11/07/2018 Final release candidate for Build 7.2
0.12.1 B7.2rc2 0495 11/01/2018 Second release candidate for Build 7.2
0.12.0 B7.2rc1 0493* 10/09/2018 First release candidate for Build 7.2
0.11.0 0482* 09/10/2018 DMS test, no delivery to I&T
0.10.0 0477* 07/31/2018 DMS test, no delivery to I&T
0.9.6 B7.1.3 0468 06/08/2018 Final release candidate for Build 7.1.3
0.9.5 B7.1.3rc3 0468 06/06/2018 Third release candidate for Build 7.1.3
0.9.4 B7.1.3rc2 0463* 05/29/2018 Second release candidate for Build 7.1.3
0.9.3 B7.1.3rc1 0457* 05/11/2018 First release candidate for Build 7.1.3
0.9.2 0441* 03/28/2018 DMS test, no delivery to I&T
0.9.1 0432* 02/16/2018 DMS test, no delivery to I&T
0.9.0 B7.1.2 0422 12/22/2017 DMS patch release to I&T 02/15/2018
0.8.0 B7.1.1 0422 DMS patch release to I&T 01/17/2018
0.8.0 B7.1 0422 11/14/2017 Final, delivered to I&T 11/17/2017
0.7.0rc7 B7.0 0303 12/13/2016 Final, delivered to I&T

Note: CRDS_CONTEXT values flagged with an asterisk in the above table are estimates (formal CONTEXT deliveries are only provided with final builds).

Unit Tests

Unit tests can be run via pytest. All tests need a the ci_watson pytest plugin to run.

pip install requests_mock ci_watson
pytest jwst

Regression Tests

Regression tests - both the data and the result reports - are currently only accessible to STScI staff members. If you do need information about this, please open an issue.

Latest regression test results can be found here:

https://boyle.stsci.edu:8081/job/RT/job/JWST/

The test builds start at 11am and 6pm local Baltimore time every day on jwcalibdev.

To run the regression tests on your local machine, you need the ci_watson pytest plugin as above. Then set the environment variable TEST_BIGDATA to our Artifactory server (STSci staff members only)

export TEST_BIGDATA=https://bytesalad.stsci.edu/artifactory/

When you run the tests, the results will get written somewhere in /tmp or /var by default. Control this with the --basetemp arg to pytest. So to run all the regression tests:

pytest --bigdata --basetemp=<PATH> jwst/tests_nightly/general

If you would like to run a specific test, find its name or ID and use the -k option:

pytest --bigdata --basetemp=<PATH> jwst/tests_nightly/general -k ami_pipeline

If developers need to update the truth files in our nightly regression tests, there are instructions in the repository wiki.

https://github.com/spacetelescope/jwst/wiki/Updating-nightly-RT

About

Python library for science observations from the James Webb Space Telescope

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Jupyter Notebook 63.7%
  • Python 35.9%
  • Pascal 0.2%
  • C++ 0.1%
  • PHP 0.1%
  • SourcePawn 0.0%