Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A2c matches sb3 #161

Merged
merged 6 commits into from
Apr 13, 2022
Merged

A2c matches sb3 #161

merged 6 commits into from
Apr 13, 2022

Conversation

KohlerHECTOR
Copy link
Collaborator

Hello, this a simple fix we did with @riccardodv for a2c (issue #160 ). We simply removed the for loop in question. We also include a test file that tests a2c on CartPole-v0, Acrobot-v1, PBall2D.

@KohlerHECTOR KohlerHECTOR changed the title test for a2c , maybe need to have direct comparison with sb3 A2c matches sb3 Apr 8, 2022
@yfletberliac yfletberliac self-requested a review April 8, 2022 17:38
Copy link
Collaborator

@TimotheeMathieu TimotheeMathieu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks !
My only comment is that we sadly cannot handle the tests you propose because they are too long for automatic checks on azure pipeline. Maybe you can make this an example or make the tests faster.

@TimotheeMathieu
Copy link
Collaborator

Ok, all green, I merge.

@TimotheeMathieu TimotheeMathieu merged commit 80679a9 into rlberry-py:main Apr 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants