stable-baselines3/tests
M. Ernestus 0c50d75ecb
TD3 Code review (#245)
* Removed unneeded overrides of feature_extractor and normalize_images in the TD3 Actor.

* Add learning rate schedule example (#248)

* Add learning rate schedule example

* Update docs/guide/examples.rst

Co-authored-by: Adam Gleave <adam@gleave.me>

* Address comments

Co-authored-by: Adam Gleave <adam@gleave.me>

* Add supported action spaces checks (#254)

* Add supported action spaces checks

* Address comment

* Use `pass` in an abstractmethod instead of deleting the arguments.

* Remove the "deterministic" keyword from the forward method of the TD3 Actor since it always is deterministic anyways.

* Rename _get_data to _get_data_to_reconstruct_model.

_get_data was too generic and could have meant anything.

* Remove the n_episodes_rollout parameter and allow passing tuples as train_freq instead.

* Fix docstring of `train_freq` parameter.

* Black fixes.

* Fix TD3 delayed update + rename `_get_data()`

* Fix TD3 test

* Normalize `train_freq` to a tuple in the constructor and turn the warning into an assert.

* Make one step the default train frequency.

* Black fixes.

* Change np.bool to bool.

* Use the tuple format to specify an amount of steps in terms of steps or episodes in the collect_collouts of the off policy algorithm.

* Use the tuple format to specify an amount of steps in terms of steps or episodes in the collect_collouts of HER.

* Use named tuple for train freq

* Rename train_freq to train_every and TrainFreq to ExperienceDuration. Also add some type annotations and documentation.

* Black fixes.

* Revert to train_freq

* Fix terminal observation issues

* Typo

* Fix action noise bug in HER

* Add assert when loading HER models

* Update version

Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
Co-authored-by: Adam Gleave <adam@gleave.me>
2021-02-27 17:33:50 +01:00
..
__init__.py Init: TD3 2019-09-05 17:29:41 +02:00
test_callbacks.py Add eval success rate logging (#255) 2020-12-08 15:49:07 +01:00
test_cnn.py TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
test_custom_policy.py Fix discrete obs support (#296) 2021-01-21 02:42:33 +02:00
test_deterministic.py Auto-formatting with black and isort (#97) 2020-07-16 16:12:16 +02:00
test_distributions.py Fix discrete obs support (#296) 2021-01-21 02:42:33 +02:00
test_env_checker.py add check to ensure action space is non-dict non-tuple for env_checker nan check (#192) 2020-10-19 00:23:51 +03:00
test_envs.py Auto-formatting with black and isort (#97) 2020-07-16 16:12:16 +02:00
test_her.py TD3 Code review (#245) 2021-02-27 17:33:50 +01:00
test_identity.py Use Monitor episode reward/length for evaluate_policy (#220) 2020-11-16 11:52:28 +01:00
test_logger.py Add Support for Text Records to Logger, Add Hint on How To Access SummaryWriter in Docs. (#303) 2021-02-01 11:56:33 +01:00
test_monitor.py Auto-formatting with black and isort (#97) 2020-07-16 16:12:16 +02:00
test_predict.py Fix DQN predict shape for single Gym env (#222) 2020-11-17 00:43:26 +02:00
test_run.py Fix off policy features extractor (#198) 2020-10-27 14:24:59 +01:00
test_save_load.py Fix discrete obs support (#296) 2021-01-21 02:42:33 +02:00
test_sde.py Implement HER (#120) 2020-10-22 11:56:43 +02:00
test_spaces.py Fix discrete obs support (#296) 2021-01-21 02:42:33 +02:00
test_tensorboard.py Auto-formatting with black and isort (#97) 2020-07-16 16:12:16 +02:00
test_utils.py Improve error messages when PPO effective batch size is 1 and when last mini-batch is truncated (#270) 2021-01-11 17:03:32 +01:00
test_vec_check_nan.py Auto-formatting with black and isort (#97) 2020-07-16 16:12:16 +02:00
test_vec_envs.py Use Monitor episode reward/length for evaluate_policy (#220) 2020-11-16 11:52:28 +01:00
test_vec_normalize.py Use Monitor episode reward/length for evaluate_policy (#220) 2020-11-16 11:52:28 +01:00