266 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Noah Dormann	775a50cc5c	saving all variables now added a2c support	2019-11-21 16:24:18 +01:00
Noah Dormann	526c37bf1f	refactored the assets in test_save_load ... fixed base_class 'params.pth'	2019-11-21 15:44:57 +01:00
Noah Dormann	26f31fd25b	corrected comment sections	2019-11-21 14:55:56 +01:00
Noah Dormann	d31a399140	undo changes to conf.py	2019-11-21 14:52:29 +01:00
Noah Dormann	17f84053b3	save implementation for a2c needed before uncommenting save and load test in test_run.py::test_onpolicy	2019-11-21 14:44:02 +01:00
Noah Dormann	fb5f192fc4	Implemented Changes suggested from Antonin-Raffin ... Added Optimizer saving	2019-11-21 14:39:44 +01:00
Noah Dormann	a7655ca6e1	Reformated every file with PEP 8 errors	2019-11-21 13:01:03 +01:00
Raffin, Antonin	8b218b8359	Merge pull request #2 from Antonin-Raffin/feat/sde ... Add State Dependent Exploration (SDE)	2019-11-21 12:50:42 +01:00
Noah Dormann	b20b70db48	Clean reformat	2019-11-21 11:51:47 +01:00
Noah Dormann	5bca52a87d	rearranged imports	2019-11-21 11:44:37 +01:00
Noah Dormann	4b6234a1c8	finished test_save_load.py test	2019-11-21 11:39:47 +01:00
Antonin Raffin	ad32aa60f3	Add sde scheduler	2019-11-18 16:03:08 +01:00
Antonin Raffin	d8a7556d84	Merge branch 'feat/sde' into feat/offpolicy-sde	2019-11-18 15:14:05 +01:00
Antonin Raffin	ef59a7e431	Update version + add docstring	2019-11-18 15:11:19 +01:00
Antonin Raffin	b9c20d443d	Update doc + add test for tanh bijector	2019-11-18 15:04:07 +01:00
Antonin Raffin	5d353d598c	Start cleanup + update docstrings	2019-11-18 14:09:31 +01:00
Antonin Raffin	fb64072859	Update sde test	2019-11-15 11:07:49 +01:00
Antonin Raffin	cdb62a93fe	Bug fix for off-policy normalization ... Now working properly	2019-11-15 11:00:31 +01:00
Antonin Raffin	f719544386	Change default batch size for SAC	2019-11-14 14:35:47 +01:00
Antonin Raffin	5278a6f3f8	Testing off policy normalization	2019-11-14 14:35:00 +01:00
Antonin Raffin	8aac10f3fa	Fix device	2019-11-13 14:38:18 +01:00
Antonin Raffin	da325a0ba7	Solve NaN issue and reduce number of parameters	2019-11-13 13:02:37 +01:00
Antonin RAFFIN	d725d01186	Normalize returns	2019-11-12 22:32:21 +01:00
Antonin Raffin	623e3cf4f9	Add SDE lr	2019-11-12 18:38:42 +01:00
Antonin Raffin	a08382faab	Add sde update for TD3	2019-11-12 18:37:13 +01:00
Noah Dormann	6cf80ccfe2	reordered imports	2019-11-12 17:12:10 +01:00
Noah Dormann	cc744a48b5	first save and load features	2019-11-12 17:03:57 +01:00
Antonin Raffin	f2a61949ae	Bump version and change default noise clipping	2019-11-08 14:59:42 +01:00
Antonin Raffin	715865a0fe	Add noise clipping	2019-11-08 13:17:38 +01:00
Antonin Raffin	f4546837c3	Add std to logger	2019-11-07 17:41:28 +01:00
Antonin Raffin	db87e0d36a	Quick and dirty SDE version for TD3	2019-11-07 17:31:52 +01:00
Antonin Raffin	95c741c707	Fix logger for discrete actions	2019-11-07 17:01:02 +01:00
Antonin Raffin	c6f90b9c3c	Improve VecNormalize syncing for evaluation	2019-11-07 11:17:26 +01:00
Antonin Raffin	6c7c8375a4	Update log interval	2019-11-07 11:16:59 +01:00
Antonin Raffin	9acff0f5b3	Remove plotting script	2019-10-31 17:01:27 +01:00
Antonin Raffin	0e092f7c52	Add plotting script	2019-10-31 16:59:35 +01:00
Antonin Raffin	9644ae89cf	Log ppo std	2019-10-31 16:17:08 +01:00
Antonin Raffin	72a6f18e43	Add sde test + fix random seed	2019-10-31 14:14:30 +01:00
Antonin Raffin	925afe784c	SDE on latent_pi	2019-10-31 11:44:27 +01:00
Antonin Raffin	862ae666b5	Try squashing the sde	2019-10-30 15:30:09 +01:00
Antonin Raffin	0174ec269e	Clean up	2019-10-29 18:43:16 +01:00
Antonin Raffin	9e8f6e0020	Add default filename for monitor	2019-10-29 18:42:34 +01:00
Antonin Raffin	c0cb9fc9c5	Fix predict method	2019-10-29 18:30:36 +01:00
Antonin Raffin	42d50ed09b	Add expln	2019-10-29 15:15:54 +01:00
Antonin Raffin	0d41bc1356	Add more logging	2019-10-29 15:15:11 +01:00
Antonin Raffin	69a348276e	Add classic advantage computation	2019-10-29 12:36:40 +01:00
Antonin Raffin	c15b4bda1e	Add first draft of SDE	2019-10-28 18:24:13 +01:00
Raffin, Antonin	701daa8cb8	Merge pull request #1 from Antonin-Raffin/feat/a2c ... Add A2C algorithm	2019-10-28 18:18:55 +01:00
Antonin Raffin	df1e7aa000	Add docstring	2019-10-28 17:42:39 +01:00
Antonin Raffin	d67822718c	Add learning rate schedule	2019-10-28 16:47:13 +01:00