Antonin RAFFIN
8f4155180e
Revert "Filter out features extractor weights"
...
This reverts commit 93f9de799add0874878a91fe9eaf8162321066b5.
2020-04-22 10:56:33 +02:00
Antonin RAFFIN
4b826f2e2d
Filter out features extractor weights
2020-04-22 10:56:17 +02:00
Antonin RAFFIN
b289aca5fe
Bug fixes at loading and predict time
2020-04-21 21:06:07 +02:00
Antonin RAFFIN
8aac9e819d
Add VecTransposeImage and fix for SAC
2020-04-21 20:41:58 +02:00
Antonin RAFFIN
17f9246257
Add get_device util and fix squash_output
2020-04-20 15:43:11 +02:00
Antonin RAFFIN
0e44cdce44
Fixed `reset_num_timesteps` behavior
2020-04-17 12:36:27 +02:00
Antonin RAFFIN
fdecd512db
Add save/load weights for policies and refactor action distributions
2020-03-31 16:29:13 +02:00
Antonin RAFFIN
fa599c65a6
Add support for Discrete observation spaces
2020-03-25 16:42:05 +01:00
Antonin RAFFIN
ba18258af6
Add proper preprocessing
2020-03-23 17:15:30 +01:00
Antonin RAFFIN
57b37513b6
Refactor handling of obs and action space
...
+ remove duplicated code
2020-03-20 10:09:09 +01:00
Antonin RAFFIN
9485b90a41
Sync predict with SB and add version file
2020-03-18 15:11:19 +01:00
Antonin RAFFIN
b37c23c149
Bump version and fix
2020-03-16 14:05:21 +01:00
Antonin RAFFIN
c3187604bc
Code cleanup: rename lr to lr_schedule + typing
2020-03-16 14:01:32 +01:00
Antonin Raffin
29d7018265
Add better logging for SAC and PPO
2020-03-13 11:43:12 +01:00
Antonin Raffin
b64873ffff
Sync callbacks
2020-03-12 12:34:25 +01:00
Antonin Raffin
18f38f8cf5
Reformat
2020-03-12 11:12:10 +01:00
Antonin Raffin
90d1558534
Type and reorder arguments
2020-03-11 12:45:21 +01:00
Antonin Raffin
20ee8cb68d
Update changelog and add more namedtuples
2020-03-10 16:55:13 +01:00
Antonin Raffin
fb4e66213d
Use NamedTuple for buffers
2020-03-10 16:43:10 +01:00
Antonin Raffin
4392759057
Comment unused code
2020-02-14 14:15:55 +01:00
Antonin Raffin
e31b139c47
Add test for predict method
2020-02-14 14:03:41 +01:00
Antonin Raffin
a2b1bf06d3
Add squash_output attribute to policy
2020-02-14 11:12:07 +01:00
Antonin Raffin
aa8b4eb22a
Reformat and type the distributions
2020-02-13 13:46:22 +01:00
Antonin Raffin
f1a4fa2d3f
Improve predict method
2020-02-12 15:25:05 +01:00
Antonin Raffin
7bafdb3a67
Add get_vec_normalize_env()
2020-02-12 11:34:29 +01:00
Antonin Raffin
75a86881b3
Add save/load for replay buffer
2020-02-05 13:10:02 +01:00
Antonin Raffin
31a862c3a9
Log success rate
2020-02-04 13:24:09 +01:00
Antonin Raffin
8acac6b0f4
Update docstring
2020-02-03 18:31:13 +01:00
Antonin Raffin
16121cf2b8
Create OffPolicyRLModel
2020-02-03 18:18:41 +01:00
Antonin Raffin
6710f1576c
Fix eval log path
2020-01-31 13:48:25 +01:00
Antonin Raffin
5d4e73544c
Fix reset_num_timesteps
2020-01-31 13:16:28 +01:00
Antonin Raffin
6d59bfd4a0
Merge branch 'master' into feat/callbacks
2020-01-31 13:09:55 +01:00
Dormann, Noah
1f0dd60b97
Fix saving on GPU - Loading on CPU ( #45 )
...
* removed policy from save, changed th.loads to map to device
* found hack: catch pickle exception and trying th.load with mapping instead, otherwise raise exception with more information -> loading cuda on cpu raises exception -> leads to th.load with map being called
* deleted todo
* updated changelog
* start of saving refactor
* first working c
* all tests pass, save refactored
* - backwards compatibilty not always
- make pytest all passing
- make typing all passing
* Fixes and simplify the save method
* Remove unused param
* Fix backward compat
* Fix docstring
2020-01-31 13:06:55 +01:00
Antonin Raffin
6ae8421615
Update docstring
2020-01-28 10:28:44 +01:00
Antonin Raffin
5c94a225ef
Minor edit to the doc
2020-01-28 10:24:02 +01:00
Antonin Raffin
a628354721
Refactor evaluation
2020-01-27 15:53:27 +01:00
Antonin Raffin
b66003cfb3
Add callback support
2020-01-27 14:32:31 +01:00
Antonin Raffin
7265d9e352
Fix multiline f-string
2020-01-23 10:56:53 +01:00
Antonin Raffin
ff0eddfb17
Partially type base class
2020-01-22 17:51:27 +01:00
Antonin Raffin
44fce7c02a
Fix typing errors and typos
2020-01-22 17:17:12 +01:00
Antonin Raffin
88f07bafb6
Convert format to f-strings
2020-01-22 16:39:25 +01:00
Antonin Raffin
37f9f13684
Revert all changes for python 2
...
+ Add makefile and pytype
2020-01-22 16:18:27 +01:00
Antonin Raffin
9e250b6818
Build doc
2020-01-20 16:19:35 +01:00
Antonin Raffin
0bed698ec5
Raise error for abstract methods
2020-01-20 12:57:40 +01:00
Antonin Raffin
c542009641
Clean up code + bug fixes
2020-01-20 11:17:55 +01:00
Antonin Raffin
ea20721632
Add TODO
2020-01-15 15:58:45 +01:00
Antonin Raffin
299ca007b5
Add comment about warmup phase
2020-01-07 17:36:26 +01:00
Antonin Raffin
8831eff163
Unify evaluation
2020-01-07 14:00:03 +01:00
Antonin Raffin
57708a628c
Add value function for SDE + TD3
2019-12-17 15:01:08 +01:00
Antonin Raffin
1d6f9bf100
Add sample freq for SDE
2019-12-17 11:47:21 +01:00