62 commits

Author	SHA1	Message	Date
Antonin Raffin	6ebad92e1b	Remove default seed and bump dependencies	2020-03-10 17:43:54 +01:00
Antonin Raffin	20ee8cb68d	Update changelog and add more namedtuples	2020-03-10 16:55:13 +01:00
Antonin Raffin	fb4e66213d	Use NamedTuple for buffers	2020-03-10 16:43:10 +01:00
Antonin Raffin	67894dab9f	Add clip_mean parameter	2020-03-09 19:02:40 +01:00
Antonin Raffin	26ccf499b3	Use normal sampling for SAC	2020-02-21 14:50:28 +01:00
Antonin Raffin	a2b1bf06d3	Add squash_output attribute to policy	2020-02-14 11:12:07 +01:00
Antonin Raffin	f1a4fa2d3f	Improve predict method	2020-02-12 15:25:05 +01:00
Antonin Raffin	8acac6b0f4	Update docstring	2020-02-03 18:31:13 +01:00
Antonin Raffin	16121cf2b8	Create OffPolicyRLModel	2020-02-03 18:18:41 +01:00
Antonin Raffin	5d4e73544c	Fix reset_num_timesteps	2020-01-31 13:16:28 +01:00
Antonin Raffin	6d59bfd4a0	Merge branch 'master' into feat/callbacks	2020-01-31 13:09:55 +01:00
Dormann, Noah	1f0dd60b97	Fix saving on GPU - Loading on CPU (#45) ... * removed policy from save, changed th.loads to map to device * found hack: catch pickle exception and trying th.load with mapping instead, otherwise raise exception with more information -> loading cuda on cpu raises exception -> leads to th.load with map being called * deleted todo * updated changelog * start of saving refactor * first working c * all tests pass, save refactored * - backwards compatibilty not always - make pytest all passing - make typing all passing * Fixes and simplify the save method * Remove unused param * Fix backward compat * Fix docstring	2020-01-31 13:06:55 +01:00
Antonin Raffin	a628354721	Refactor evaluation	2020-01-27 15:53:27 +01:00
Antonin Raffin	b66003cfb3	Add callback support	2020-01-27 14:32:31 +01:00
Antonin Raffin	44fce7c02a	Fix typing errors and typos	2020-01-22 17:17:12 +01:00
Antonin Raffin	9e250b6818	Build doc	2020-01-20 16:19:35 +01:00
Antonin Raffin	c542009641	Clean up code + bug fixes	2020-01-20 11:17:55 +01:00
Antonin Raffin	8831eff163	Unify evaluation	2020-01-07 14:00:03 +01:00
Antonin RAFFIN	4a79f7e5a7	Print std reward for evaluation	2019-12-24 13:12:04 +01:00
Antonin RAFFIN	57c890f3e9	LeakyClip not working yet	2019-12-22 14:38:30 +01:00
Antonin RAFFIN	3a7508ac16	Fix double clip	2019-12-22 13:56:30 +01:00
Antonin Raffin	f6c475a44b	Add use_expln as a policy argument	2019-12-20 18:10:24 +01:00
Antonin Raffin	9b3b34c9c4	Sample batch_size noise matrices for SAC	2019-12-20 11:28:44 +01:00
Antonin Raffin	e894f1f11b	Add leakyclip	2019-12-19 18:20:02 +01:00
Antonin Raffin	84ebc3d7da	Relax the HardTanh limit	2019-12-19 15:28:51 +01:00
Antonin Raffin	bff0ca0ea8	Use HardTanh to relax the constrain	2019-12-19 11:59:00 +01:00
Antonin Raffin	c05c990285	Remove norm clipping	2019-12-18 16:56:51 +01:00
Antonin Raffin	e49d97bf98	Fix infs in SAC by bounding the mean	2019-12-18 13:45:33 +01:00
Antonin Raffin	1d6f9bf100	Add sample freq for SDE	2019-12-17 11:47:21 +01:00
Antonin Raffin	919dfee452	Try to clip grad norm	2019-12-17 11:14:44 +01:00
Antonin Raffin	d63cef7693	Add gradient clipping for SAC	2019-12-06 18:32:57 +01:00
Antonin Raffin	0117cc37f4	Merge branch 'master' into feat/sde-features	2019-12-05 16:33:41 +01:00
Noah Dormann	4c0f6cbe53	update get_opt_parameters to remove duplicate code	2019-12-05 08:43:12 +01:00
Antonin Raffin	1ac1a7cad5	Reformat	2019-12-02 14:27:38 +01:00
Antonin Raffin	8e9802784c	Revert previous changes in SAC + SDE	2019-12-02 14:06:30 +01:00
Antonin Raffin	4e39a0627c	Refactor: enable sde net arch for TD3 and SAC	2019-12-02 14:06:17 +01:00
Antonin RAFFIN	879191b26a	Bug fix in SAC with constant ent coeff + try batch sde matrices	2019-12-01 13:11:13 +01:00
Noah Dormann	6928879f5a	Refactored doc-strings	2019-11-28 16:30:13 +01:00
Noah Dormann	e95858784a	Formatted all files	2019-11-28 15:38:04 +01:00
Noah Dormann	9ff59eaf3d	Added attribute self.policy_class to prevent errors when using self.policy as class	2019-11-28 15:25:01 +01:00
Noah Dormann	e26564e0ec	Added function for setting up any attributes that weren't saved and thus not loaded	2019-11-28 13:35:16 +01:00
Antonin Raffin	fbe29a7298	Track down autograd error ... "Trying to backward through the graph a second time" -> added a comment	2019-11-27 17:29:47 +01:00
Antonin Raffin	fe67a98711	Log more values	2019-11-26 17:44:06 +01:00
Antonin Raffin	5483e02d1a	Add SDE support for SAC	2019-11-26 15:26:12 +01:00
Antonin Raffin	604a19fbc3	Cleanup + update doc	2019-11-22 13:33:12 +01:00
Noah Dormann	03a0d437ef	refactor	2019-11-21 16:49:49 +01:00
Noah Dormann	2d72f6d1b5	Added SAC, TD3, A2C ... Missing CEMRL	2019-11-21 16:46:53 +01:00
Antonin Raffin	f719544386	Change default batch size for SAC	2019-11-14 14:35:47 +01:00
Antonin Raffin	5278a6f3f8	Testing off policy normalization	2019-11-14 14:35:00 +01:00
Antonin Raffin	d67822718c	Add learning rate schedule	2019-10-28 16:47:13 +01:00