mirror of
https://github.com/saymrwulf/stable-baselines3.git
synced 2026-05-16 21:10:08 +00:00
303df08a80
* add GEM project to project section of doc * Update docs/misc/projects.rst * Update changelog.rst Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
96 lines
4.6 KiB
ReStructuredText
96 lines
4.6 KiB
ReStructuredText
.. _projects:
|
|
|
|
Projects
|
|
=========
|
|
|
|
This is a list of projects using stable-baselines3.
|
|
Please tell us, if you want your project to appear on this page ;)
|
|
|
|
|
|
RL Reach
|
|
--------
|
|
|
|
A platform for running reproducible reinforcement learning experiments for customisable robotic reaching tasks. This self-contained and straightforward toolbox allows its users to quickly investigate and identify optimal training configurations.
|
|
|
|
| Authors: Pierre Aumjaud, David McAuliffe, Francisco Javier Rodríguez Lera, Philip Cardiff
|
|
| Github: https://github.com/PierreExeter/rl_reach
|
|
| Paper: https://arxiv.org/abs/2102.04916
|
|
|
|
|
|
Generalized State Dependent Exploration for Deep Reinforcement Learning in Robotics
|
|
-----------------------------------------------------------------------------------
|
|
|
|
An exploration method to train RL agent directly on real robots.
|
|
It was the starting point of Stable-Baselines3.
|
|
|
|
| Author: Antonin Raffin, Freek Stulp
|
|
| Github: https://github.com/DLR-RM/stable-baselines3/tree/sde
|
|
| Paper: https://arxiv.org/abs/2005.05719
|
|
|
|
Reacher
|
|
-------
|
|
A solution to the second project of the Udacity deep reinforcement learning course.
|
|
It is an example of:
|
|
|
|
- wrapping single and multi-agent Unity environments to make them usable in Stable-Baselines3
|
|
- creating experimentation scripts which train and run A2C, PPO, TD3 and SAC models (a better choice for this one is https://github.com/DLR-RM/rl-baselines3-zoo)
|
|
- generating several pre-trained models which solve the reacher environment
|
|
|
|
| Author: Marios Koulakis
|
|
| Github: https://github.com/koulakis/reacher-deep-reinforcement-learning
|
|
|
|
SUMO-RL
|
|
-------
|
|
A simple interface to instantiate RL environments with SUMO for Traffic Signal Control.
|
|
|
|
- Supports Multiagent RL
|
|
- Compatibility with gym.Env and popular RL libraries such as stable-baselines3 and RLlib
|
|
- Easy customisation: state and reward definitions are easily modifiable
|
|
|
|
| Author: Lucas Alegre
|
|
| Github: https://github.com/LucasAlegre/sumo-rl
|
|
|
|
gym-pybullet-drones
|
|
-------------------
|
|
PyBullet Gym environments for single and multi-agent reinforcement learning of quadcopter control.
|
|
|
|
- Physics-based simulation for the development and test of quadcopter control.
|
|
- Compatibility with ``gym.Env``, RLlib's MultiAgentEnv.
|
|
- Learning and testing script templates for stable-baselines3 and RLlib.
|
|
|
|
| Author: Jacopo Panerati
|
|
| Github: https://github.com/utiasDSL/gym-pybullet-drones/
|
|
| Paper: https://arxiv.org/abs/2103.02142
|
|
|
|
SuperSuit
|
|
---------
|
|
|
|
SuperSuit contains easy to use wrappers for Gym (and multi-agent PettingZoo) environments to do all forms of common preprocessing (frame stacking, converting graphical observations to greyscale, max-and-skip for Atari, etc.). It also notably includes:
|
|
|
|
-Wrappers that apply lambda functions to observations, actions, or rewards with a single line of code.
|
|
-All wrappers can be used natively on vector environments, wrappers exist to Gym environments to vectorized environments and concatenate multiple vector environments together
|
|
-A wrapper is included that allows for using regular single agent RL libraries (e.g. stable baselines) to learn simple multi-agent PettingZoo environments, explained in this tutorial:
|
|
|
|
| Author: Justin Terry
|
|
| GitHub: https://github.com/PettingZoo-Team/SuperSuit
|
|
| Tutorial on multi-agent support in stable baselines: https://towardsdatascience.com/multi-agent-deep-reinforcement-learning-in-15-lines-of-code-using-pettingzoo-e0b963c0820b
|
|
|
|
gym-electric-motor
|
|
-------------------
|
|
|
|
An OpenAI gym environment for the simulation and control of electric drive trains.
|
|
Think of Matlab/Simulink for electric motors, inverters, and load profiles, but non-graphical and open-source in Python.
|
|
|
|
`gym-electric-motor` offers a rich interface for customization, including
|
|
- plug-and-play of different control algorithms ranging from classical controllers (like field-oriented control) up to any RL agent you can find,
|
|
- reward shaping,
|
|
- load profiling,
|
|
- finite-set or continuous-set control,
|
|
- one-phase and three-phase motors such as induction machines and permanent magnet synchronous motors, among others.
|
|
|
|
SB3 is used as an example in one of many tutorials showcasing the easy usage of `gym-electric-motor`.
|
|
|
|
| Author: `Paderborn University, LEA department <https://github.com/upb-lea>`_
|
|
| GitHub: https://github.com/upb-lea/gym-electric-motor
|
|
| SB3 Tutorial: `Colab Link <https://colab.research.google.com/github/upb-lea/gym-electric-motor/blob/master/examples/reinforcement_learning_controllers/stable_baselines3_dqn_disc_pmsm_example.ipynb>`_
|
|
| Paper: `JOSS <https://joss.theoj.org/papers/10.21105/joss.02498>`_, `TNNLS <https://ieeexplore.ieee.org/document/9241851>`_, `ArXiv <https://arxiv.org/abs/1910.09434>`_
|