stable-baselines3/stable_baselines3/common
Quentin Gallouédec c5adad82b2
Multiprocessing support for HerReplayBuffer (#704)
* IM compat. modif from old fork

* mp her working, without offline sampling

* update readme and doc

* fix discrete action/obs space case

* handle offline sampling

* fix pos to be consistent with the old version

* improve typing and docstring

* fix discrete obs special case

* new her, using episode uid

* deal with full buffer

* offline not implemented

* info storage; compute_reward as arg; offline sampling error

* offline sampling; timeout_termination; fix last_trans detection

* rm max_episode_length from tests

* fix loading and loading test

* Fix episode sampling strategy

* Episode interrupted not valid

* Typo

* Fix infos sampling, next_obs desired goals, offline sampling

* update tests for multienvs

* speed up code

* handle timeout sampling when samping

* give up ep_uid for ep_start and ep_lenght

* speed up sampling

* Improve docstring

* Typos and renaming

* Fix typing

* Fix linter warnings

* Renaming + add note

* fix reward type

* Fix future sampling strategy

* Fix future goal selection strategy

* env_fn as lambda

* Re-fix linter warnings

* Formatting

* Fix offline sampling

* restore the initial performance budget

* Remove max_episode_length for HerReplayBuffer kwargs

* SubprcVecEnv compat test

* Dedicated SubrocVecEnv test rm n_envs from parametrization

* Back to using the env arg instead of compute_reward

* Up VecEnv import

* fix lint warnings

* fix docstring

* Fix device issue

* actor_loss_modifier in SAV and TD3

* Merge RewardModifier and ActorLossModifier into Surgeon

* update surgeon for rnd

* fix uninteded merge

* fix uninteded merge

* fix unintended merge

* Rm unintended merge

* Fix KeyError

* Remove useless `all_inds`

* Minor docstring format

* Fix hint

* speedup!

* Speedup again

* speedup

* np.nonzero

* fix env normalization

* flat sampling for speedup

* typo

* drop online

* format

* remove observation from env_cheker (see #1335)

* update changelog

* default device to "auto"

* add comment for info storage

* add comment for ep_start and ep_length attributes

* a[b][c] to a[b, c]

* comment flatnonzero and unravel_index

* update _sample_goals docstring

* Fix future gaol sampling for split episode

* add informative error message for learning_starts too small

* use keyword arg for env

* try fix pytye

* Update stable_baselines3/common/off_policy_algorithm.py

Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>

* Add `copy_info_dict` option

* Ignore pytype

* Update changelog

* Rename variables and improve documentation

* Ignore new bug bear rule

* Add note about future strategy

* Add deprecation warning

* Fix bug trying to pickle buffer kwargs

---------

Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
2023-03-20 12:03:57 +01:00
..
envs Downgrade sphinx-autodoc-typehints (#1291) 2023-01-23 10:56:45 +01:00
sb2_compat Upgrade code to Python 3.7+ syntax using pyupgrade (#887) 2022-04-25 13:01:38 +03:00
vec_env Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
__init__.py Update docs (custom policy, type hints) (#167) 2020-09-29 20:41:14 +03:00
atari_wrappers.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
base_class.py Switch to pyproject.toml and ruff (#1361) 2023-03-11 22:15:26 +01:00
buffers.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
callbacks.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
distributions.py Standardize the use of from gym import spaces (#1240) 2023-01-02 14:51:11 +01:00
env_checker.py Multiprocessing support for HerReplayBuffer (#704) 2023-03-20 12:03:57 +01:00
env_util.py Fix stable_baselines3/common/env_util.py type hint (#1192) 2022-11-29 15:36:55 +01:00
evaluation.py Upgrade black formatting (#1310) 2023-02-02 11:58:41 +01:00
logger.py Switch to pyproject.toml and ruff (#1361) 2023-03-11 22:15:26 +01:00
monitor.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
noise.py Add the argument dtype (default to float32) to the noise (#1301) 2023-02-07 13:42:14 +01:00
off_policy_algorithm.py Multiprocessing support for HerReplayBuffer (#704) 2023-03-20 12:03:57 +01:00
on_policy_algorithm.py Upgrade black formatting (#1310) 2023-02-02 11:58:41 +01:00
policies.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
preprocessing.py Fix support of image like normalized inputs (#1214) 2022-12-20 13:18:28 +01:00
results_plotter.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
running_mean_std.py Fix test_vec_normalize.py, test_tensorboard.py and common/monitor.py type hint (#1194) 2023-01-13 18:28:22 +01:00
save_util.py Fix Atari Roms download, enable RUF linting (#1379) 2023-03-12 18:47:52 +01:00
torch_layers.py Removed shared layers in mlp_extractor (#1292) 2023-01-23 14:55:19 +01:00
type_aliases.py Fix stable_baselines3/common/type_aliases.py type hint (#1189) 2022-11-29 12:26:16 +01:00
utils.py Fix image-based normalized env loading (#1321) 2023-02-15 14:17:18 +01:00