39 commits

Author	SHA1	Message	Date
Antonin Raffin	44fce7c02a	Fix typing errors and typos	2020-01-22 17:17:12 +01:00
Antonin Raffin	c542009641	Clean up code + bug fixes	2020-01-20 11:17:55 +01:00
Antonin Raffin	03e853997a	Add squash_output and expln as policy param for ppo and a2c	2020-01-15 13:21:20 +01:00
Antonin Raffin	1d6f9bf100	Add sample freq for SDE	2019-12-17 11:47:21 +01:00
Antonin Raffin	1ac1a7cad5	Reformat	2019-12-02 14:27:38 +01:00
Antonin Raffin	3cdd5f20af	Bug fix + add test for sde net arch	2019-12-02 14:14:48 +01:00
Antonin Raffin	4e39a0627c	Refactor: enable sde net arch for TD3 and SAC	2019-12-02 14:06:17 +01:00
Antonin Raffin	a2a8bbdf11	Sample n matrices for A2C/PPO when using SDE	2019-12-02 11:48:34 +01:00
Antonin Raffin	0885dbe74b	Bug fix in choosing the distribution	2019-11-25 15:02:10 +01:00
Antonin Raffin	5d6649d92b	Enable separate feature extraction for SDE	2019-11-25 14:54:13 +01:00
Antonin Raffin	d0003ee4ec	Enable kwargs for proba dist	2019-11-25 14:00:21 +01:00
Antonin Raffin	5bbb14188d	Unify A2C and TD3 SDE implementation	2019-11-25 13:19:33 +01:00
Antonin Raffin	c47be0086e	Add docstrings	2019-11-22 17:24:47 +01:00
Antonin Raffin	f0f2f10d1e	Change default architecture	2019-11-22 17:24:14 +01:00
Antonin Raffin	b84e5e9e27	Move flexible mlp to common	2019-11-22 13:06:41 +01:00
Antonin Raffin	99ea0b3a54	Cleanup	2019-11-22 11:42:58 +01:00
Antonin Raffin	925afe784c	SDE on latent_pi	2019-10-31 11:44:27 +01:00
Antonin Raffin	0174ec269e	Clean up	2019-10-29 18:43:16 +01:00
Antonin Raffin	c15b4bda1e	Add first draft of SDE	2019-10-28 18:24:13 +01:00
Antonin Raffin	df1e7aa000	Add docstring	2019-10-28 17:42:39 +01:00
Antonin Raffin	d67822718c	Add learning rate schedule	2019-10-28 16:47:13 +01:00
Antonin RAFFIN	53898f3d1a	Add flexible mlp	2019-10-17 13:32:25 +02:00
Antonin Raffin	ef50bb81e8	Add support for categorical distribution	2019-10-08 13:06:38 +02:00
Antonin Raffin	440166fe26	Add a parameter to disable ortho init	2019-09-26 16:29:47 +02:00
Antonin Raffin	322399e8fe	Update collect rollout	2019-09-25 13:20:06 +02:00
Antonin Raffin	f4fe1362f0	Renaming	2019-09-24 14:53:03 +02:00
Antonin RAFFIN	8adb8f9931	Change default dist to gaussian	2019-09-22 12:56:27 +02:00
Antonin RAFFIN	ddaafcbc36	Refactor: add distributions	2019-09-22 12:52:49 +02:00
Antonin RAFFIN	70e1d673a9	Separate policy and value net	2019-09-21 18:12:06 +02:00
Antonin RAFFIN	2469ff3859	Reformat	2019-09-21 17:17:09 +02:00
Antonin RAFFIN	e8ddd1f901	Improve initialization	2019-09-21 16:48:51 +02:00
Antonin Raffin	0e727a5f72	Full compat for VecEnv + bug fixes for cuda	2019-09-20 16:43:19 +02:00
Antonin RAFFIN	cc4380eccd	Add eval env and clip vf	2019-09-19 17:18:41 +02:00
Antonin RAFFIN	26f0c8d8e5	Refactor buffer	2019-09-19 11:43:15 +02:00
Antonin RAFFIN	149148d4c7	Bug fix actor forward	2019-09-18 23:55:41 +02:00
Antonin RAFFIN	525fe43552	Bug fix rollout buffer	2019-09-18 23:48:47 +02:00
Antonin RAFFIN	e1c1d5c4ab	Bug fixes (not working yet)	2019-09-18 22:12:32 +02:00
Antonin RAFFIN	6bb7e183d2	Running PPO (not working yet)	2019-09-18 15:35:17 +02:00
Antonin Raffin	54dd7ea60d	Start PPO	2019-09-18 13:10:27 +02:00