mujoco-torch To build the Docker image, cd into docker, copy mjkey.txt into the directory, and docker build . The following should run without errors (but might take a while for cymj to build the thing)