saymrwulf/stable-baselines3
1
0
Fork 0
mirror of https://github.com/saymrwulf/stable-baselines3.git synced 2026-09-04 20:23:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
348 commits 18 branches 32 tags 5.2 MiB
Commit graph

210 commits

Author SHA1 Message Date
Raffin, Antonin
464dd773e6 Update comment 2019-12-05 14:46:02 +01:00
Raffin, Antonin
03ecb17ef6 Update error message 2019-12-05 14:41:39 +01:00
Noah Dormann
88d4f44d55 added set_env test and set_env wrapping 2019-12-05 13:59:07 +01:00
Noah Dormann
cf1d7118a5 replaced file with file_path 2019-12-05 13:44:02 +01:00
Noah Dormann
8062ed6036 fixed load, to check if environment ist correctly 2019-12-05 13:36:19 +01:00
Noah Dormann
4b1bab7f85 implemented set_env method 2019-12-05 09:11:30 +01:00
Noah Dormann
8460bfe397 added some comments to _load_from_file 2019-12-05 08:56:04 +01:00
Noah Dormann
6560ae9952 using other_file instead of other_files 2019-12-05 08:52:26 +01:00
Noah Dormann
7c8d375bcb added get_parameter_list function 2019-12-05 08:50:11 +01:00
Noah Dormann
c3b0398d56 Changed load so it still works when env not saved 
improved save function
 2019-12-05 08:40:28 +01:00
Dormann, Noah
bea2799691 comment refactoring 
Co-Authored-By: Raffin, Antonin <Antonin.Raffin@dlr.de>
 2019-12-05 08:10:39 +01:00
Dormann, Noah
a756f40223 comment refactoring 
Co-Authored-By: Raffin, Antonin <Antonin.Raffin@dlr.de>
 2019-12-05 08:10:25 +01:00
Dormann, Noah
fdb544e775 comment refactoring 
Co-Authored-By: Raffin, Antonin <Antonin.Raffin@dlr.de>
 2019-12-05 08:10:14 +01:00
Dormann, Noah
aa66d2f82e comment refactoring 
Co-Authored-By: Raffin, Antonin <Antonin.Raffin@dlr.de>
 2019-12-05 08:09:51 +01:00
Dormann, Noah
85d3743224 added standart exclude parameters 
Co-Authored-By: Raffin, Antonin <Antonin.Raffin@dlr.de>
 2019-12-05 08:09:26 +01:00
Antonin Raffin
1ac1a7cad5 Reformat 2019-12-02 14:27:38 +01:00
Antonin Raffin
4e39a0627c Refactor: enable sde net arch for TD3 and SAC 2019-12-02 14:06:17 +01:00
Antonin Raffin
7a6a500398 Allow to use states directly as features for sde 2019-12-02 11:48:16 +01:00
Antonin RAFFIN
879191b26a Bug fix in SAC with constant ent coeff + try batch sde matrices 2019-12-01 13:11:13 +01:00
Noah Dormann
6928879f5a Refactored doc-strings 2019-11-28 16:30:13 +01:00
Noah Dormann
7ce610fade Deleted exact match parameter of load_parameters 2019-11-28 16:11:35 +01:00
Noah Dormann
ee6f938ddc Added option to explicitly specify excluded parameters 2019-11-28 15:42:53 +01:00
Noah Dormann
e95858784a Formatted all files 2019-11-28 15:38:04 +01:00
Noah Dormann
751ccf85e7 _setup_model() is now called when model is loaded 2019-11-28 15:33:52 +01:00
Noah Dormann
9ff59eaf3d Added attribute self.policy_class to prevent errors when using self.policy as class 2019-11-28 15:25:01 +01:00
Noah Dormann
e26564e0ec Added function for setting up any attributes that weren't saved and thus not loaded 2019-11-28 13:35:16 +01:00
Noah Dormann
c75582dfbe resolving conflicts 
# Conflicts:
#	torchy_baselines/a2c/a2c.py
#	torchy_baselines/ppo/ppo.py

Added optimizer params test
 2019-11-28 12:12:06 +01:00
Noah Dormann
812cab84ac Changed PPO deterministic 2019-11-28 11:20:40 +01:00
Noah Dormann
b75ffe166a Cleared base_class.load description 2019-11-28 10:36:21 +01:00
Antonin Raffin
fbe29a7298 Track down autograd error 
"Trying to backward through the graph a second time" -> added a comment
 2019-11-27 17:29:47 +01:00
Antonin Raffin
5483e02d1a Add SDE support for SAC 2019-11-26 15:26:12 +01:00
Antonin Raffin
5d6649d92b Enable separate feature extraction for SDE 2019-11-25 14:54:13 +01:00
Antonin Raffin
d0003ee4ec Enable kwargs for proba dist 2019-11-25 14:00:21 +01:00
Antonin Raffin
5bbb14188d Unify A2C and TD3 SDE implementation 2019-11-25 13:19:33 +01:00
Antonin Raffin
c47be0086e Add docstrings 2019-11-22 17:24:47 +01:00
Antonin Raffin
03d2ab10f8 Fix clipped action when adapting noise with TD3 2019-11-22 15:04:34 +01:00
Antonin Raffin
604a19fbc3 Cleanup + update doc 2019-11-22 13:33:12 +01:00
Antonin Raffin
b84e5e9e27 Move flexible mlp to common 2019-11-22 13:06:41 +01:00
Antonin Raffin
99ea0b3a54 Cleanup 2019-11-22 11:42:58 +01:00
Noah Dormann
4f8f936451 Don't save replay_buffer by default 2019-11-21 17:27:46 +01:00
Noah Dormann
2d72f6d1b5 Added SAC, TD3, A2C 
Missing CEMRL
 2019-11-21 16:46:53 +01:00
Noah Dormann
775a50cc5c saving all variables now added a2c support 2019-11-21 16:24:18 +01:00
Noah Dormann
526c37bf1f refactored the assets in test_save_load 
fixed base_class 'params.pth'
 2019-11-21 15:44:57 +01:00
Noah Dormann
26f31fd25b corrected comment sections 2019-11-21 14:55:56 +01:00
Noah Dormann
fb5f192fc4 Implemented Changes suggested from Antonin-Raffin 
Added Optimizer saving
 2019-11-21 14:39:44 +01:00
Noah Dormann
a7655ca6e1 Reformated every file with PEP 8 errors 2019-11-21 13:01:03 +01:00
Noah Dormann
4b6234a1c8 finished test_save_load.py test 2019-11-21 11:39:47 +01:00
Antonin Raffin
d8a7556d84 Merge branch 'feat/sde' into feat/offpolicy-sde 2019-11-18 15:14:05 +01:00
Antonin Raffin
ef59a7e431 Update version + add docstring 2019-11-18 15:11:19 +01:00
Antonin Raffin
b9c20d443d Update doc + add test for tanh bijector 2019-11-18 15:04:07 +01:00
Antonin Raffin
5d353d598c Start cleanup + update docstrings 2019-11-18 14:09:31 +01:00
Antonin Raffin
cdb62a93fe Bug fix for off-policy normalization 
Now working properly
 2019-11-15 11:00:31 +01:00
Antonin Raffin
5278a6f3f8 Testing off policy normalization 2019-11-14 14:35:00 +01:00
Antonin Raffin
a08382faab Add sde update for TD3 2019-11-12 18:37:13 +01:00
Noah Dormann
6cf80ccfe2 reordered imports 2019-11-12 17:12:10 +01:00
Noah Dormann
cc744a48b5 first save and load features 2019-11-12 17:03:57 +01:00
Antonin Raffin
715865a0fe Add noise clipping 2019-11-08 13:17:38 +01:00
Antonin Raffin
f4546837c3 Add std to logger 2019-11-07 17:41:28 +01:00
Antonin Raffin
db87e0d36a Quick and dirty SDE version for TD3 2019-11-07 17:31:52 +01:00
Antonin Raffin
c6f90b9c3c Improve VecNormalize syncing for evaluation 2019-11-07 11:17:26 +01:00
Antonin Raffin
72a6f18e43 Add sde test + fix random seed 2019-10-31 14:14:30 +01:00
Antonin Raffin
925afe784c SDE on latent_pi 2019-10-31 11:44:27 +01:00
Antonin Raffin
862ae666b5 Try squashing the sde 2019-10-30 15:30:09 +01:00
Antonin Raffin
0174ec269e Clean up 2019-10-29 18:43:16 +01:00
Antonin Raffin
9e8f6e0020 Add default filename for monitor 2019-10-29 18:42:34 +01:00
Antonin Raffin
42d50ed09b Add expln 2019-10-29 15:15:54 +01:00
Antonin Raffin
69a348276e Add classic advantage computation 2019-10-29 12:36:40 +01:00
Antonin Raffin
c15b4bda1e Add first draft of SDE 2019-10-28 18:24:13 +01:00
Antonin Raffin
df1e7aa000 Add docstring 2019-10-28 17:42:39 +01:00
Antonin Raffin
d67822718c Add learning rate schedule 2019-10-28 16:47:13 +01:00
Antonin Raffin
799e30ff3d Bug fixes for A2C and PPO 2019-10-28 14:27:32 +01:00
Antonin Raffin
584f549fa1 Bug fix for discrete actions 2019-10-25 12:00:37 +02:00
Antonin RAFFIN
3bc746c6ee Add logger for PPO 2019-10-17 13:44:48 +02:00
Antonin Raffin
64de9923d6 Buf fixes for python 2 2019-10-15 13:24:53 +02:00
Antonin Raffin
b5656531d1 Enable logger for SAC/TD3 + refactor 2019-10-10 13:47:13 +02:00
Antonin Raffin
dbaa5daca6 Add logger and Monitor wrapper 2019-10-10 13:41:54 +02:00
Antonin Raffin
ef50bb81e8 Add support for categorical distribution 2019-10-08 13:06:38 +02:00
Antonin Raffin
4d0c033bf2 Bug fix when randomly sampling actions 2019-10-07 16:36:48 +02:00
Antonin Raffin
37ab9d10f1 Rescale actions and add action noise 2019-10-07 16:26:03 +02:00
Antonin Raffin
b4dc9d4e4d Add doc 2019-09-26 11:46:40 +02:00
Antonin Raffin
322399e8fe Update collect rollout 2019-09-25 13:20:06 +02:00
Antonin Raffin
6bfbb7198a Rename seed 2019-09-24 16:59:47 +02:00
Antonin Raffin
32648d9029 Add docstrings 2019-09-24 15:30:58 +02:00
Antonin Raffin
f4fe1362f0 Renaming 2019-09-24 14:53:03 +02:00
Antonin Raffin
d22caac616 Working SAC 2019-09-24 14:15:12 +02:00
Antonin RAFFIN
98e9560913 Remove note 2019-09-22 21:33:35 +02:00
Antonin RAFFIN
1bd2e42995 Add a note for squashed gaussian 2019-09-22 14:15:22 +02:00
Antonin RAFFIN
ddaafcbc36 Refactor: add distributions 2019-09-22 12:52:49 +02:00
Antonin RAFFIN
2469ff3859 Reformat 2019-09-21 17:17:09 +02:00
Antonin RAFFIN
dfe1ab9690 Revert buffer update 2019-09-21 16:03:22 +02:00
Antonin RAFFIN
a196306d9e Update replay buffer 2019-09-21 15:54:26 +02:00
Antonin RAFFIN
bcdd99d22c Fix deterministic run 2019-09-21 15:53:28 +02:00
Antonin Raffin
a9b8276efb Attempt to fix loss of perf because of VecEnvs 2019-09-20 18:06:08 +02:00
Antonin Raffin
0e727a5f72 Full compat for VecEnv + bug fixes for cuda 2019-09-20 16:43:19 +02:00
Antonin Raffin
255ff10bff PPO VecEnv compat 2019-09-20 15:19:04 +02:00
Antonin Raffin
56053bc692 Add stable-baselines VecEnvs 2019-09-20 15:18:25 +02:00
Antonin RAFFIN
cc4380eccd Add eval env and clip vf 2019-09-19 17:18:41 +02:00
Antonin RAFFIN
fe8b415cbf First sign of life 2019-09-19 16:21:28 +02:00
Antonin RAFFIN
ad089f5b19 Add explained variance 2019-09-19 11:43:27 +02:00
Antonin RAFFIN
26f0c8d8e5 Refactor buffer 2019-09-19 11:43:15 +02:00
Antonin RAFFIN
6bb7e183d2 Running PPO (not working yet) 2019-09-18 15:35:17 +02:00
Antonin Raffin
54dd7ea60d Start PPO 2019-09-18 13:10:27 +02:00
Antonin Raffin
f04754afec Refactor for collecting rollout 2019-09-12 14:00:55 +02:00
Antonin Raffin
5e3a84d551 Refactor policies 2019-09-12 11:19:06 +02:00
Antonin Raffin
d4e2dc8a9c Add CEM-RL 2019-09-06 14:01:10 +02:00
Antonin Raffin
90882ee846 Fixes for python 2 + env from string 2019-09-06 11:46:25 +02:00
Antonin Raffin
904742714d Fixes for python 2 2019-09-06 11:43:02 +02:00
Antonin Raffin
68028c71a1 Seed env + fix max action 2019-09-06 11:09:56 +02:00
Antonin Raffin
9cf289b997 Bug fixes + add evaluate script 2019-09-06 10:44:55 +02:00
Antonin Raffin
46d8d9725b Init: TD3 2019-09-05 17:29:41 +02:00