Antonin RAFFIN
7ae54206ce
Reformat and code cleanup
2020-04-23 15:18:21 +02:00
Antonin RAFFIN
041f2bc59a
Cleanup, bug fixes + more tests
2020-04-22 13:14:22 +02:00
Antonin RAFFIN
73fb8d1c63
Add CNN support for TD3
2020-04-22 11:05:46 +02:00
Antonin RAFFIN
a4df08cd28
Complete save/load for TD3 policy
2020-04-20 15:43:23 +02:00
Antonin RAFFIN
17f9246257
Add get_device util and fix squash_output
2020-04-20 15:43:11 +02:00
Antonin RAFFIN
aa1026ee87
Added `optimizer and optimizer_kwargs to policy_kwargs`
2020-04-17 15:13:45 +02:00
Antonin RAFFIN
0e44cdce44
Fixed `reset_num_timesteps` behavior
2020-04-17 12:36:27 +02:00
Antonin RAFFIN
c97dbb3173
Fix device arg that was not pass to children networks
2020-04-06 15:12:20 +02:00
Antonin RAFFIN
c264403816
Rename for consistency
...
+ add _predict to actors
+ improve sac actor code
2020-03-31 17:48:23 +02:00
Antonin RAFFIN
fdecd512db
Add save/load weights for policies and refactor action distributions
2020-03-31 16:29:13 +02:00
Antonin RAFFIN
72a88a8d92
Fix type hint for activation fn
2020-03-24 10:10:37 +01:00
Antonin RAFFIN
ba18258af6
Add proper preprocessing
2020-03-23 17:15:30 +01:00
Antonin RAFFIN
4b2092f55a
Remove base network
2020-03-23 15:31:14 +01:00
Antonin RAFFIN
dcb54b5301
Remove CEMRL
2020-03-23 14:48:38 +01:00
Antonin RAFFIN
b96a081e5f
Add check for image space
2020-03-20 11:20:57 +01:00
Antonin RAFFIN
57b37513b6
Refactor handling of obs and action space
...
+ remove duplicated code
2020-03-20 10:09:09 +01:00
Antonin RAFFIN
b37c23c149
Bump version and fix
2020-03-16 14:05:21 +01:00
Antonin RAFFIN
c3187604bc
Code cleanup: rename lr to lr_schedule + typing
2020-03-16 14:01:32 +01:00
Antonin RAFFIN
a67bb75438
Type td3 policies
2020-03-16 13:31:06 +01:00
Antonin Raffin
29d7018265
Add better logging for SAC and PPO
2020-03-13 11:43:12 +01:00
Antonin Raffin
70e601c03c
Improve code and bump version
2020-03-12 15:34:35 +01:00
Antonin Raffin
b64873ffff
Sync callbacks
2020-03-12 12:34:25 +01:00
Antonin Raffin
18f38f8cf5
Reformat
2020-03-12 11:12:10 +01:00
Antonin Raffin
90d1558534
Type and reorder arguments
2020-03-11 12:45:21 +01:00
Antonin Raffin
6ebad92e1b
Remove default seed and bump dependencies
2020-03-10 17:43:54 +01:00
Antonin Raffin
20ee8cb68d
Update changelog and add more namedtuples
2020-03-10 16:55:13 +01:00
Antonin Raffin
fb4e66213d
Use NamedTuple for buffers
2020-03-10 16:43:10 +01:00
Antonin Raffin
a2b1bf06d3
Add squash_output attribute to policy
2020-02-14 11:12:07 +01:00
Antonin Raffin
f1a4fa2d3f
Improve predict method
2020-02-12 15:25:05 +01:00
Antonin Raffin
240833ffef
Add type aliases for buffer samples
2020-02-11 17:33:22 +01:00
Antonin Raffin
2ce31c1e21
Fix entropy loss for squashed Gaussian and VecEnv seeding
2020-02-11 17:22:03 +01:00
Antonin Raffin
8acac6b0f4
Update docstring
2020-02-03 18:31:13 +01:00
Antonin Raffin
16121cf2b8
Create OffPolicyRLModel
2020-02-03 18:18:41 +01:00
Antonin Raffin
5d4e73544c
Fix reset_num_timesteps
2020-01-31 13:16:28 +01:00
Antonin Raffin
6d59bfd4a0
Merge branch 'master' into feat/callbacks
2020-01-31 13:09:55 +01:00
Dormann, Noah
1f0dd60b97
Fix saving on GPU - Loading on CPU ( #45 )
...
* removed policy from save, changed th.loads to map to device
* found hack: catch pickle exception and trying th.load with mapping instead, otherwise raise exception with more information -> loading cuda on cpu raises exception -> leads to th.load with map being called
* deleted todo
* updated changelog
* start of saving refactor
* first working c
* all tests pass, save refactored
* - backwards compatibilty not always
- make pytest all passing
- make typing all passing
* Fixes and simplify the save method
* Remove unused param
* Fix backward compat
* Fix docstring
2020-01-31 13:06:55 +01:00
Antonin Raffin
a628354721
Refactor evaluation
2020-01-27 15:53:27 +01:00
Antonin Raffin
b66003cfb3
Add callback support
2020-01-27 14:32:31 +01:00
Antonin Raffin
44fce7c02a
Fix typing errors and typos
2020-01-22 17:17:12 +01:00
Antonin Raffin
9e250b6818
Build doc
2020-01-20 16:19:35 +01:00
Antonin Raffin
c542009641
Clean up code + bug fixes
2020-01-20 11:17:55 +01:00
Antonin Raffin
60d5f4463d
Add use_expln option for td3
2020-01-08 17:04:28 +01:00
Antonin Raffin
8831eff163
Unify evaluation
2020-01-07 14:00:03 +01:00
Antonin Raffin
57708a628c
Add value function for SDE + TD3
2019-12-17 15:01:08 +01:00
Antonin Raffin
1d6f9bf100
Add sample freq for SDE
2019-12-17 11:47:21 +01:00
Antonin Raffin
0117cc37f4
Merge branch 'master' into feat/sde-features
2019-12-05 16:33:41 +01:00
Noah Dormann
ff7c4d24f4
deleted types in train_actor td3
2019-12-05 08:46:26 +01:00
Antonin Raffin
1ac1a7cad5
Reformat
2019-12-02 14:27:38 +01:00
Antonin Raffin
4e39a0627c
Refactor: enable sde net arch for TD3 and SAC
2019-12-02 14:06:17 +01:00
Noah Dormann
6928879f5a
Refactored doc-strings
2019-11-28 16:30:13 +01:00