1. Python-3.5.2
2. TensorFlow-1.3.0
3. Roboschool-1.0
4. MuJoCo-1.31
5. mujoco-py-0.5.7: make sure it's 0.5.7
6. pytest-3.3.0 for testing

I tried MuJoCo for a month, finishing hw1. Then switched to free Roboschool from OpenAI.

Note, Roboschool appears to crash with Python-3.5.4, openai/roboschool#79