Try to play with dm_control and request a trial license for mujoco. Since the trial license is for local machine, I have to set colab to run locally. Things mostly work okay. I still have some problems here and there (like ffmpeg can’t generate video). I have to install pyopengl and add the following to .bashrc to get things work
export MUJOCO_GL=osmesa export PYOPENGL_PLATFORM=osmesa export MJLIB_PATH=$HOME/.mujoco/mujoco200_linux/bin/libmujoco200.so export MJKEY_PATH=$HOME/.mujoco/mujoco200_linux/mjkey.txt export LD_LIBRARY_PATH=$HOME/.mujoco/mujoco200_linux/bin:$LD_LIBRARY_PATH export MUJOCO_PY_MJPRO_PATH=$HOME/.mujoco/mujoco200_linux/ export MUJOCO_PY_MJKEY_PATH=$HOME/.mujoco/mujoco200_linux/mjkey.txt