Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increasing number of steps per episode/ iteration #57

Open
AizazSharif opened this issue Feb 3, 2022 · 3 comments
Open

Increasing number of steps per episode/ iteration #57

AizazSharif opened this issue Feb 3, 2022 · 3 comments
Labels
more-information-needed More information is needed to proceed question Further information is requested

Comments

@AizazSharif
Copy link

Hi @praveen-palanisamy,

I hope you are doing great.
I am facing one issue whether somehow I cannot cross the limit on number of steps ("max_steps" in scenario.py) per episode. The maximum in some scenarios I have reached is either 1024 or 2048 steps, and after the limit another episode starts.

Increasing the value in scenario.py breaks the code. Any help in this regard will be really appreaciated.

@praveen-palanisamy
Copy link
Owner

Good to hear from you!
Which scenario specifically are you trying to increase the max_steps for?
Based on the map for the Town where the scenario is situated/setup, it may not be recommended to have a larger value for max_steps since that could change the dynamics/behavior of the agent's learned policy.
The limits set in the scenarios file is based on what a reasonable multi-agent policy would take to drive the agents to their respective goals/destinations plus an extra buffer.

@praveen-palanisamy praveen-palanisamy added more-information-needed More information is needed to proceed question Further information is requested labels Feb 10, 2022
@AizazSharif
Copy link
Author

Thanks for the reply @praveen-palanisamy.
In scenarios.py I am referring in general to all of the multi-agent scenarios where max_steps is either 500 or 2048 limit. The default goal destinations definitely are hard to reach using the current step limits. Is there any way to change it within the framework or make it flexible?
Any help would be much appreciated!

@no-response no-response bot removed the more-information-needed More information is needed to proceed label Feb 10, 2022
@praveen-palanisamy
Copy link
Owner

Okay!
Yes, you can experiment with different max steps limit by modifying the max_steps values for the scenario(s) in the scenarios.py file.
You mentioned in your first message that you tried that and ran into issues when you increased the values in scenarios.py. Could you share the full log of what went wrong?

@praveen-palanisamy praveen-palanisamy added the more-information-needed More information is needed to proceed label Apr 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
more-information-needed More information is needed to proceed question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants