Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

step function effect in fourrooms doesn't fit the description #11

Open
Mingpan opened this issue Apr 17, 2018 · 1 comment
Open

step function effect in fourrooms doesn't fit the description #11

Mingpan opened this issue Apr 17, 2018 · 1 comment

Comments

@Mingpan
Copy link

Mingpan commented Apr 17, 2018

In the description it reads:
The agent can perform one of four actions,
up, down, left or right, which have a stochastic effect. With probability 2/3, the actions
cause the agent to move one cell in the corresponding direction, and with probability 1/3,
the agent moves instead in one of the other three directions, each with 1/9 probability. In
either case, if the movement would take the agent into a wall then the agent remains in the
same cell.

However, if I understand the code correctly, the self.currentcell is set to be the next cell before the random process happens. Therefore the agent will land in next cell with prob 2/3, which is correct, but with prob 1/3 it will land in the neighboring cells of the nextcell (equivalent to taking an additional step). That doesn't seem to fit the description above and in the paper.

@tsaket
Copy link

tsaket commented Aug 27, 2018

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants