75 commits

Author	SHA1	Message	Date
Antonin RAFFIN	72a88a8d92	Fix type hint for activation fn	2020-03-24 10:10:37 +01:00
Antonin RAFFIN	ba18258af6	Add proper preprocessing	2020-03-23 17:15:30 +01:00
Antonin RAFFIN	4b2092f55a	Remove base network	2020-03-23 15:31:14 +01:00
Antonin RAFFIN	dcb54b5301	Remove CEMRL	2020-03-23 14:48:38 +01:00
Antonin RAFFIN	57b37513b6	Refactor handling of obs and action space ... + remove duplicated code	2020-03-20 10:09:09 +01:00
Antonin RAFFIN	b37c23c149	Bump version and fix	2020-03-16 14:05:21 +01:00
Antonin RAFFIN	c3187604bc	Code cleanup: rename lr to lr_schedule + typing	2020-03-16 14:01:32 +01:00
Antonin RAFFIN	a67bb75438	Type td3 policies	2020-03-16 13:31:06 +01:00
Antonin Raffin	29d7018265	Add better logging for SAC and PPO	2020-03-13 11:43:12 +01:00
Antonin Raffin	70e601c03c	Improve code and bump version	2020-03-12 15:34:35 +01:00
Antonin Raffin	b64873ffff	Sync callbacks	2020-03-12 12:34:25 +01:00
Antonin Raffin	18f38f8cf5	Reformat	2020-03-12 11:12:10 +01:00
Antonin Raffin	90d1558534	Type and reorder arguments	2020-03-11 12:45:21 +01:00
Antonin Raffin	6ebad92e1b	Remove default seed and bump dependencies	2020-03-10 17:43:54 +01:00
Antonin Raffin	20ee8cb68d	Update changelog and add more namedtuples	2020-03-10 16:55:13 +01:00
Antonin Raffin	fb4e66213d	Use NamedTuple for buffers	2020-03-10 16:43:10 +01:00
Antonin Raffin	67894dab9f	Add clip_mean parameter	2020-03-09 19:02:40 +01:00
Antonin Raffin	26ccf499b3	Use normal sampling for SAC	2020-02-21 14:50:28 +01:00
Antonin Raffin	a2b1bf06d3	Add squash_output attribute to policy	2020-02-14 11:12:07 +01:00
Antonin Raffin	f1a4fa2d3f	Improve predict method	2020-02-12 15:25:05 +01:00
Antonin Raffin	8acac6b0f4	Update docstring	2020-02-03 18:31:13 +01:00
Antonin Raffin	16121cf2b8	Create OffPolicyRLModel	2020-02-03 18:18:41 +01:00
Antonin Raffin	5d4e73544c	Fix reset_num_timesteps	2020-01-31 13:16:28 +01:00
Antonin Raffin	6d59bfd4a0	Merge branch 'master' into feat/callbacks	2020-01-31 13:09:55 +01:00
Dormann, Noah	1f0dd60b97	Fix saving on GPU - Loading on CPU (#45) ... * removed policy from save, changed th.loads to map to device * found hack: catch pickle exception and trying th.load with mapping instead, otherwise raise exception with more information -> loading cuda on cpu raises exception -> leads to th.load with map being called * deleted todo * updated changelog * start of saving refactor * first working c * all tests pass, save refactored * - backwards compatibilty not always - make pytest all passing - make typing all passing * Fixes and simplify the save method * Remove unused param * Fix backward compat * Fix docstring	2020-01-31 13:06:55 +01:00
Antonin Raffin	a628354721	Refactor evaluation	2020-01-27 15:53:27 +01:00
Antonin Raffin	b66003cfb3	Add callback support	2020-01-27 14:32:31 +01:00
Antonin Raffin	44fce7c02a	Fix typing errors and typos	2020-01-22 17:17:12 +01:00
Antonin Raffin	9e250b6818	Build doc	2020-01-20 16:19:35 +01:00
Antonin Raffin	c542009641	Clean up code + bug fixes	2020-01-20 11:17:55 +01:00
Antonin Raffin	8831eff163	Unify evaluation	2020-01-07 14:00:03 +01:00
Antonin RAFFIN	4a79f7e5a7	Print std reward for evaluation	2019-12-24 13:12:04 +01:00
Antonin RAFFIN	57c890f3e9	LeakyClip not working yet	2019-12-22 14:38:30 +01:00
Antonin RAFFIN	3a7508ac16	Fix double clip	2019-12-22 13:56:30 +01:00
Antonin Raffin	f6c475a44b	Add use_expln as a policy argument	2019-12-20 18:10:24 +01:00
Antonin Raffin	9b3b34c9c4	Sample batch_size noise matrices for SAC	2019-12-20 11:28:44 +01:00
Antonin Raffin	e894f1f11b	Add leakyclip	2019-12-19 18:20:02 +01:00
Antonin Raffin	84ebc3d7da	Relax the HardTanh limit	2019-12-19 15:28:51 +01:00
Antonin Raffin	bff0ca0ea8	Use HardTanh to relax the constrain	2019-12-19 11:59:00 +01:00
Antonin Raffin	c05c990285	Remove norm clipping	2019-12-18 16:56:51 +01:00
Antonin Raffin	e49d97bf98	Fix infs in SAC by bounding the mean	2019-12-18 13:45:33 +01:00
Antonin Raffin	1d6f9bf100	Add sample freq for SDE	2019-12-17 11:47:21 +01:00
Antonin Raffin	919dfee452	Try to clip grad norm	2019-12-17 11:14:44 +01:00
Antonin Raffin	d63cef7693	Add gradient clipping for SAC	2019-12-06 18:32:57 +01:00
Antonin Raffin	0117cc37f4	Merge branch 'master' into feat/sde-features	2019-12-05 16:33:41 +01:00
Noah Dormann	4c0f6cbe53	update get_opt_parameters to remove duplicate code	2019-12-05 08:43:12 +01:00
Antonin Raffin	1ac1a7cad5	Reformat	2019-12-02 14:27:38 +01:00
Antonin Raffin	8e9802784c	Revert previous changes in SAC + SDE	2019-12-02 14:06:30 +01:00
Antonin Raffin	4e39a0627c	Refactor: enable sde net arch for TD3 and SAC	2019-12-02 14:06:17 +01:00
Antonin RAFFIN	879191b26a	Bug fix in SAC with constant ent coeff + try batch sde matrices	2019-12-01 13:11:13 +01:00