stable-baselines3/stable_baselines3
M. Ernestus 0c50d75ecb
TD3 Code review (#245)
* Removed unneeded overrides of feature_extractor and normalize_images in the TD3 Actor.

* Add learning rate schedule example (#248)

* Add learning rate schedule example

* Update docs/guide/examples.rst

Co-authored-by: Adam Gleave <adam@gleave.me>

* Address comments

Co-authored-by: Adam Gleave <adam@gleave.me>

* Add supported action spaces checks (#254)

* Add supported action spaces checks

* Address comment

* Use `pass` in an abstractmethod instead of deleting the arguments.

* Remove the "deterministic" keyword from the forward method of the TD3 Actor since it always is deterministic anyways.

* Rename _get_data to _get_data_to_reconstruct_model.

_get_data was too generic and could have meant anything.

* Remove the n_episodes_rollout parameter and allow passing tuples as train_freq instead.

* Fix docstring of `train_freq` parameter.

* Black fixes.

* Fix TD3 delayed update + rename `_get_data()`

* Fix TD3 test

* Normalize `train_freq` to a tuple in the constructor and turn the warning into an assert.

* Make one step the default train frequency.

* Black fixes.

* Change np.bool to bool.

* Use the tuple format to specify an amount of steps in terms of steps or episodes in the collect_collouts of the off policy algorithm.

* Use the tuple format to specify an amount of steps in terms of steps or episodes in the collect_collouts of HER.

* Use named tuple for train freq

* Rename train_freq to train_every and TrainFreq to ExperienceDuration. Also add some type annotations and documentation.

* Black fixes.

* Revert to train_freq

* Fix terminal observation issues

* Typo

* Fix action noise bug in HER

* Add assert when loading HER models

* Update version

Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
Co-authored-by: Adam Gleave <adam@gleave.me>
2021-02-27 17:33:50 +01:00
..
a2c Add supported action spaces checks (#254) 2020-12-06 14:05:10 +02:00
common TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
ddpg TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
dqn TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
her TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
ppo Improve error messages when PPO effective batch size is 1 and when last mini-batch is truncated (#270) 2021-01-11 17:03:32 +01:00
sac TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
td3 TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
__init__.py Implement HER (#120) 2020-10-22 11:56:43 +02:00
py.typed Rename to stable-baselines3 2020-05-05 15:02:35 +02:00
version.txt TD3 Code review (#245) 2021-02-27 17:33:50 +01:00