Please download public libraries keras-rl: https://github.com/keras-rl/keras-rl and miniworld: https://github.com/maximecb/gym-miniworld before running.
Replace in keras rl:
rl/agents/dqn.py with dqn.py provided here
rl/agents/ddpg.py with ddpg.py provided here
Replace in Miniworld:
miniword/miniworld.py with miniworld.py provided here
miniword/envs/sim2real1.py with sim2real1.py provided here
miniword/envs/sim2real2.py with sim2real2.py provided here


halgan.py contains the training of HALGAN on MiniWorld. Dataset needs to be collected and stored in data/
beta_vae.py contains the training of the beta vae used in baselines.
dqn.py and ddpg.py contain the main code in classes HALGANDQNAgent and HALGANDDPGAgent.
vher_ddpg.py is the setup script for running vher experiments with ddpg.py

A trained model for HALGAN and the baseline beta vae are provided within data/

Full repository with dependencies will be made available publicly after acceptace.
