Doc update (custom policy + fix her example) (#436)

This commit is contained in:
Antonin RAFFIN 2021-05-16 18:21:07 +02:00 committed by GitHub
parent 1ce911994b
commit 378d197b00
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
4 changed files with 13 additions and 7 deletions

View file

@ -388,6 +388,11 @@ you only need to specify ``net_arch=[256, 256]`` (here, two hidden layers of 256
between the actor and the critic are allowed (to prevent issues with target networks). between the actor and the critic are allowed (to prevent issues with target networks).
.. note::
For advanced customization of off-policy algorithms policies, please take a look at the code.
A good understanding of the algorithm used is required, see discussion in `issue #425 <https://github.com/DLR-RM/stable-baselines3/issues/425>`_
.. code-block:: python .. code-block:: python
from stable_baselines3 import SAC from stable_baselines3 import SAC

View file

@ -416,7 +416,7 @@ The parking env is a goal-conditioned continuous control task, in which the vehi
# we have to manually specify the max number of steps per episode # we have to manually specify the max number of steps per episode
max_episode_length=100, max_episode_length=100,
online_sampling=True, online_sampling=True,
) ),
verbose=1, verbose=1,
buffer_size=int(1e6), buffer_size=int(1e6),
learning_rate=1e-3, learning_rate=1e-3,

View file

@ -70,7 +70,8 @@ Documentation:
- Clarified pip installation in Zsh (@tom-doerr) - Clarified pip installation in Zsh (@tom-doerr)
- Clarified return computation for on-policy algorithms (TD(lambda) estimate was used) - Clarified return computation for on-policy algorithms (TD(lambda) estimate was used)
- Added example for using ``ProcgenEnv`` - Added example for using ``ProcgenEnv``
- Added note about advanced custom policy example for off-policy algorithms
- Fixed DQN unicode checkmarks
Release 1.0 (2021-03-15) Release 1.0 (2021-03-15)
------------------------ ------------------------

View file

@ -41,11 +41,11 @@ Can I use?
============= ====== =========== ============= ====== ===========
Space Action Observation Space Action Observation
============= ====== =========== ============= ====== ===========
Discrete ✔ ✔ Discrete ✔️ ✔️
Box ❌ ✔ Box ❌ ✔️
MultiDiscrete ❌ ✔ MultiDiscrete ❌ ✔️
MultiBinary ❌ ✔ MultiBinary ❌ ✔️
Dict ❌ ✔️ Dict ❌ ✔️️
============= ====== =========== ============= ====== ===========