Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does RLzoo support Dict gym env state? #9

Open
GIS-PuppetMaster opened this issue Feb 2, 2020 · 2 comments
Open

Does RLzoo support Dict gym env state? #9

GIS-PuppetMaster opened this issue Feb 2, 2020 · 2 comments
Labels
enhancement New feature or request

Comments

@GIS-PuppetMaster
Copy link

My customized gym env has a dict type obs_space, even I also customized ActorNetwork and CriticNetwork, I found out RLzoo's source code seems only support single input and can not handle dict state.
Is there any plan to support dict gym env state?

@quantumiracle
Copy link
Member

Hi,
It supports dict state, but you need a wrapper for your env.
Please take a look at the FlattenDictWrapper (./common/env_wrappers.py) for robotics env.

@GIS-PuppetMaster
Copy link
Author

Hi,
It supports dict state, but you need a wrapper for your env.
Please take a look at the FlattenDictWrapper (./common/env_wrappers.py) for robotics env.

Thanks, I think maybe supporting a preprocessing class like keras-rl is more flexible.

@quantumiracle quantumiracle added the enhancement New feature or request label Apr 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants