Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate incorporating more lidar into the state space #39

Open
retinfai opened this issue Jun 17, 2023 · 1 comment
Open

Investigate incorporating more lidar into the state space #39

retinfai opened this issue Jun 17, 2023 · 1 comment

Comments

@retinfai
Copy link
Collaborator

retinfai commented Jun 17, 2023

Currently, we are reducing the 640 points of lidar down to 10 by averaging. A great deal of information is lost which could help the agent drive better.

The reason for the current approach is learning time. 1M steps is currently what is standard. A previous experiment using CNNs resulted in the car driving only ~30 steps before crashing after 500k steps. Thus, a great deal more training in the order of 10M steps would be necessary to train the agent.

Investigate this more thoroughly. One idea, is to use CNN layers to reduce the lidar signal before passing it through fully connected layers to determine the final actions of the agent.

@retinfai retinfai changed the title Use CNN instead of average reduce approach to lidar points Investigate incorporating more lidar into the state space Apr 9, 2024
@retinfai
Copy link
Collaborator Author

retinfai commented Apr 9, 2024

additionally, maybe training for 10M steps is also an approach

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant