mirror of
https://github.com/saymrwulf/stable-baselines3.git
synced 2026-07-30 20:18:15 +00:00
parent
304c17dc78
commit
a7f30b04e3
1 changed files with 1 additions and 1 deletions
|
|
@ -185,7 +185,7 @@ Some basic advice:
|
|||
|
||||
Two important things to keep in mind when creating a custom environment is to avoid breaking Markov assumption
|
||||
and properly handle termination due to a timeout (maximum number of steps in an episode).
|
||||
For instance, if there is some time delay between action and observation (e.g. due to wifi communication), you should give an history of observations
|
||||
For instance, if there is some time delay between action and observation (e.g. due to wifi communication), you should give a history of observations
|
||||
as input.
|
||||
|
||||
Termination due to timeout (max number of steps per episode) needs to be handled separately. You should fill the key in the info dict: ``info["TimeLimit.truncated"] = True``.
|
||||
|
|
|
|||
Loading…
Reference in a new issue