48 commits

Author	SHA1	Message	Date
Antonin Raffin	44fce7c02a	Fix typing errors and typos	2020-01-22 17:17:12 +01:00
Antonin Raffin	9e250b6818	Build doc	2020-01-20 16:19:35 +01:00
Antonin Raffin	c542009641	Clean up code + bug fixes	2020-01-20 11:17:55 +01:00
Antonin Raffin	8831eff163	Unify evaluation	2020-01-07 14:00:03 +01:00
Antonin RAFFIN	4a79f7e5a7	Print std reward for evaluation	2019-12-24 13:12:04 +01:00
Antonin RAFFIN	57c890f3e9	LeakyClip not working yet	2019-12-22 14:38:30 +01:00
Antonin RAFFIN	3a7508ac16	Fix double clip	2019-12-22 13:56:30 +01:00
Antonin Raffin	f6c475a44b	Add use_expln as a policy argument	2019-12-20 18:10:24 +01:00
Antonin Raffin	9b3b34c9c4	Sample batch_size noise matrices for SAC	2019-12-20 11:28:44 +01:00
Antonin Raffin	e894f1f11b	Add leakyclip	2019-12-19 18:20:02 +01:00
Antonin Raffin	84ebc3d7da	Relax the HardTanh limit	2019-12-19 15:28:51 +01:00
Antonin Raffin	bff0ca0ea8	Use HardTanh to relax the constrain	2019-12-19 11:59:00 +01:00
Antonin Raffin	c05c990285	Remove norm clipping	2019-12-18 16:56:51 +01:00
Antonin Raffin	e49d97bf98	Fix infs in SAC by bounding the mean	2019-12-18 13:45:33 +01:00
Antonin Raffin	1d6f9bf100	Add sample freq for SDE	2019-12-17 11:47:21 +01:00
Antonin Raffin	919dfee452	Try to clip grad norm	2019-12-17 11:14:44 +01:00
Antonin Raffin	d63cef7693	Add gradient clipping for SAC	2019-12-06 18:32:57 +01:00
Antonin Raffin	0117cc37f4	Merge branch 'master' into feat/sde-features	2019-12-05 16:33:41 +01:00
Noah Dormann	4c0f6cbe53	update get_opt_parameters to remove duplicate code	2019-12-05 08:43:12 +01:00
Antonin Raffin	1ac1a7cad5	Reformat	2019-12-02 14:27:38 +01:00
Antonin Raffin	8e9802784c	Revert previous changes in SAC + SDE	2019-12-02 14:06:30 +01:00
Antonin Raffin	4e39a0627c	Refactor: enable sde net arch for TD3 and SAC	2019-12-02 14:06:17 +01:00
Antonin RAFFIN	879191b26a	Bug fix in SAC with constant ent coeff + try batch sde matrices	2019-12-01 13:11:13 +01:00
Noah Dormann	6928879f5a	Refactored doc-strings	2019-11-28 16:30:13 +01:00
Noah Dormann	e95858784a	Formatted all files	2019-11-28 15:38:04 +01:00
Noah Dormann	9ff59eaf3d	Added attribute self.policy_class to prevent errors when using self.policy as class	2019-11-28 15:25:01 +01:00
Noah Dormann	e26564e0ec	Added function for setting up any attributes that weren't saved and thus not loaded	2019-11-28 13:35:16 +01:00
Antonin Raffin	fbe29a7298	Track down autograd error ... "Trying to backward through the graph a second time" -> added a comment	2019-11-27 17:29:47 +01:00
Antonin Raffin	fe67a98711	Log more values	2019-11-26 17:44:06 +01:00
Antonin Raffin	5483e02d1a	Add SDE support for SAC	2019-11-26 15:26:12 +01:00
Antonin Raffin	604a19fbc3	Cleanup + update doc	2019-11-22 13:33:12 +01:00
Noah Dormann	03a0d437ef	refactor	2019-11-21 16:49:49 +01:00
Noah Dormann	2d72f6d1b5	Added SAC, TD3, A2C ... Missing CEMRL	2019-11-21 16:46:53 +01:00
Antonin Raffin	f719544386	Change default batch size for SAC	2019-11-14 14:35:47 +01:00
Antonin Raffin	5278a6f3f8	Testing off policy normalization	2019-11-14 14:35:00 +01:00
Antonin Raffin	d67822718c	Add learning rate schedule	2019-10-28 16:47:13 +01:00
Antonin Raffin	ab64ff464e	Add tensorboard_log dummy arg	2019-10-14 11:09:22 +02:00
Antonin Raffin	b5656531d1	Enable logger for SAC/TD3 + refactor	2019-10-10 13:47:13 +02:00
Antonin Raffin	37ab9d10f1	Rescale actions and add action noise	2019-10-07 16:26:03 +02:00
Antonin RAFFIN	12f854e1aa	Fix learning starts	2019-10-01 21:56:37 +02:00
Antonin Raffin	b4dc9d4e4d	Add doc	2019-09-26 11:46:40 +02:00
Antonin Raffin	70e5de1d1b	Update SAC defaults	2019-09-25 17:07:54 +02:00
Antonin Raffin	0e4fc9c0ac	Bug fix SAC	2019-09-25 13:30:08 +02:00
Antonin Raffin	322399e8fe	Update collect rollout	2019-09-25 13:20:06 +02:00
Antonin Raffin	6bfbb7198a	Rename seed	2019-09-24 16:59:47 +02:00
Antonin Raffin	32648d9029	Add docstrings	2019-09-24 15:30:58 +02:00
Antonin Raffin	f4fe1362f0	Renaming	2019-09-24 14:53:03 +02:00
Antonin Raffin	d22caac616	Working SAC	2019-09-24 14:15:12 +02:00