61 commits

Author	SHA1	Message	Date
Antonin Raffin	d8a7556d84	Merge branch 'feat/sde' into feat/offpolicy-sde	2019-11-18 15:14:05 +01:00
Antonin Raffin	ef59a7e431	Update version + add docstring	2019-11-18 15:11:19 +01:00
Antonin Raffin	b9c20d443d	Update doc + add test for tanh bijector	2019-11-18 15:04:07 +01:00
Antonin Raffin	5d353d598c	Start cleanup + update docstrings	2019-11-18 14:09:31 +01:00
Antonin Raffin	cdb62a93fe	Bug fix for off-policy normalization ... Now working properly	2019-11-15 11:00:31 +01:00
Antonin Raffin	5278a6f3f8	Testing off policy normalization	2019-11-14 14:35:00 +01:00
Antonin Raffin	a08382faab	Add sde update for TD3	2019-11-12 18:37:13 +01:00
Antonin Raffin	715865a0fe	Add noise clipping	2019-11-08 13:17:38 +01:00
Antonin Raffin	f4546837c3	Add std to logger	2019-11-07 17:41:28 +01:00
Antonin Raffin	db87e0d36a	Quick and dirty SDE version for TD3	2019-11-07 17:31:52 +01:00
Antonin Raffin	c6f90b9c3c	Improve VecNormalize syncing for evaluation	2019-11-07 11:17:26 +01:00
Antonin Raffin	72a6f18e43	Add sde test + fix random seed	2019-10-31 14:14:30 +01:00
Antonin Raffin	925afe784c	SDE on latent_pi	2019-10-31 11:44:27 +01:00
Antonin Raffin	862ae666b5	Try squashing the sde	2019-10-30 15:30:09 +01:00
Antonin Raffin	0174ec269e	Clean up	2019-10-29 18:43:16 +01:00
Antonin Raffin	9e8f6e0020	Add default filename for monitor	2019-10-29 18:42:34 +01:00
Antonin Raffin	42d50ed09b	Add expln	2019-10-29 15:15:54 +01:00
Antonin Raffin	69a348276e	Add classic advantage computation	2019-10-29 12:36:40 +01:00
Antonin Raffin	c15b4bda1e	Add first draft of SDE	2019-10-28 18:24:13 +01:00
Antonin Raffin	df1e7aa000	Add docstring	2019-10-28 17:42:39 +01:00
Antonin Raffin	d67822718c	Add learning rate schedule	2019-10-28 16:47:13 +01:00
Antonin Raffin	799e30ff3d	Bug fixes for A2C and PPO	2019-10-28 14:27:32 +01:00
Antonin Raffin	584f549fa1	Bug fix for discrete actions	2019-10-25 12:00:37 +02:00
Antonin RAFFIN	3bc746c6ee	Add logger for PPO	2019-10-17 13:44:48 +02:00
Antonin Raffin	64de9923d6	Buf fixes for python 2	2019-10-15 13:24:53 +02:00
Antonin Raffin	b5656531d1	Enable logger for SAC/TD3 + refactor	2019-10-10 13:47:13 +02:00
Antonin Raffin	dbaa5daca6	Add logger and Monitor wrapper	2019-10-10 13:41:54 +02:00
Antonin Raffin	ef50bb81e8	Add support for categorical distribution	2019-10-08 13:06:38 +02:00
Antonin Raffin	4d0c033bf2	Bug fix when randomly sampling actions	2019-10-07 16:36:48 +02:00
Antonin Raffin	37ab9d10f1	Rescale actions and add action noise	2019-10-07 16:26:03 +02:00
Antonin Raffin	b4dc9d4e4d	Add doc	2019-09-26 11:46:40 +02:00
Antonin Raffin	322399e8fe	Update collect rollout	2019-09-25 13:20:06 +02:00
Antonin Raffin	6bfbb7198a	Rename seed	2019-09-24 16:59:47 +02:00
Antonin Raffin	32648d9029	Add docstrings	2019-09-24 15:30:58 +02:00
Antonin Raffin	f4fe1362f0	Renaming	2019-09-24 14:53:03 +02:00
Antonin Raffin	d22caac616	Working SAC	2019-09-24 14:15:12 +02:00
Antonin RAFFIN	98e9560913	Remove note	2019-09-22 21:33:35 +02:00
Antonin RAFFIN	1bd2e42995	Add a note for squashed gaussian	2019-09-22 14:15:22 +02:00
Antonin RAFFIN	ddaafcbc36	Refactor: add distributions	2019-09-22 12:52:49 +02:00
Antonin RAFFIN	2469ff3859	Reformat	2019-09-21 17:17:09 +02:00
Antonin RAFFIN	dfe1ab9690	Revert buffer update	2019-09-21 16:03:22 +02:00
Antonin RAFFIN	a196306d9e	Update replay buffer	2019-09-21 15:54:26 +02:00
Antonin RAFFIN	bcdd99d22c	Fix deterministic run	2019-09-21 15:53:28 +02:00
Antonin Raffin	a9b8276efb	Attempt to fix loss of perf because of VecEnvs	2019-09-20 18:06:08 +02:00
Antonin Raffin	0e727a5f72	Full compat for VecEnv + bug fixes for cuda	2019-09-20 16:43:19 +02:00
Antonin Raffin	255ff10bff	PPO VecEnv compat	2019-09-20 15:19:04 +02:00
Antonin Raffin	56053bc692	Add stable-baselines VecEnvs	2019-09-20 15:18:25 +02:00
Antonin RAFFIN	cc4380eccd	Add eval env and clip vf	2019-09-19 17:18:41 +02:00
Antonin RAFFIN	fe8b415cbf	First sign of life	2019-09-19 16:21:28 +02:00
Antonin RAFFIN	ad089f5b19	Add explained variance	2019-09-19 11:43:27 +02:00