Fix sde_sample_freq for SAC (#32)

* Fix `sde_sample_freq` for SAC

* [ci skip] Add Acknowledgments
This commit is contained in:
Antonin RAFFIN 2020-05-24 16:44:44 +02:00 committed by GitHub
parent 3da0d142b4
commit 9b42b9717a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
4 changed files with 10 additions and 3 deletions

View file

@ -227,5 +227,11 @@ Stable-Baselines3 is currently maintained by [Ashley Hill](https://github.com/hi
To any interested in making the baselines better, there is still some documentation that needs to be done. To any interested in making the baselines better, there is still some documentation that needs to be done.
If you want to contribute, please read [**CONTRIBUTING.md**](./CONTRIBUTING.md) guide first. If you want to contribute, please read [**CONTRIBUTING.md**](./CONTRIBUTING.md) guide first.
## Acknowledgments
The initial work to develop Stable Baselines3 was partially funded by the project *Reduced Complexity Models* from the *Helmholtz-Gemeinschaft Deutscher Forschungszentren*.
The original version, Stable Baselines, was created in the [robotics lab U2IS](http://u2is.ensta-paristech.fr/index.php?lang=en) ([INRIA Flowers](https://flowers.inria.fr/) team) at [ENSTA ParisTech](http://www.ensta-paristech.fr/en).
Logo credits: [L.M. Tenkes](https://www.instagram.com/lucillehue/) Logo credits: [L.M. Tenkes](https://www.instagram.com/lucillehue/)

View file

@ -3,7 +3,7 @@
Changelog Changelog
========== ==========
Pre-Release 0.6.0a9 (WIP) Pre-Release 0.6.0a10 (WIP)
------------------------------ ------------------------------
Breaking Changes: Breaking Changes:
@ -24,6 +24,7 @@ Bug Fixes:
- Fixed a bug that prevented model trained on cpu to be loaded on gpu - Fixed a bug that prevented model trained on cpu to be loaded on gpu
- Fixed version number that had a new line included - Fixed version number that had a new line included
- Fixed weird seg fault in docker image due to FakeImageEnv by reducing screen size - Fixed weird seg fault in docker image due to FakeImageEnv by reducing screen size
- Fixed ``sde_sample_freq`` that was not taken into account for SAC
Deprecations: Deprecations:
^^^^^^^^^^^^^ ^^^^^^^^^^^^^

View file

@ -798,7 +798,7 @@ class OffPolicyRLModel(BaseRLModel):
while not done: while not done:
if self.use_sde and self.sde_sample_freq > 0 and n_steps % self.sde_sample_freq == 0: if self.use_sde and self.sde_sample_freq > 0 and total_steps % self.sde_sample_freq == 0:
# Sample a new noise matrix # Sample a new noise matrix
self.actor.reset_noise() self.actor.reset_noise()

View file

@ -1 +1 @@
0.6.0a9 0.6.0a10