mirror of
https://github.com/saymrwulf/stable-baselines3.git
synced 2026-09-05 20:30:42 +00:00
* Fix failing set_env test * Fix test failiing due to deprectation of env.seed * Adjust mean reward threshold in failing test * Fix her test failing due to rng * Change seed and revert reward threshold to 90 * Pin gym version * Make VecEnv compatible with gym seeding change * Revert change to VecEnv reset signature * Change subprocenv seed cmd to call reset instead * Fix type check * Add backward compat * Add `compat_gym_seed` helper * Add goal env checks in env_checker * Add docs on HER requirements for envs * Capture user warning in test with inverted box space * Update ale-py version * Fix randint * Allow noop_max to be zero * Update changelog * Update docker image * Update doc conda env and dockerfile * Custom envs should not have any warnings * Fix test for numpy >= 1.21 * Add check for vectorized compute reward * Bump to gym 0.24 * Fix gym default step docstring * Test downgrading gym * Revert "Test downgrading gym" This reverts commit 0072b77156c006ada8a1d6e26ce347ed85a83eeb. * Fix protobuf error * Fix in dependencies * Fix protobuf dep * Use newest version of cartpole * Update gym * Fix warning * Loosen required scipy version * Scipy no longer needed * Try gym 0.25 * Silence warnings from gym * Filter warnings during tests * Update doc * Update requirements * Add gym 26 compat in vec env * Fixes in envs and tests for gym 0.26+ * Enforce gym 0.26 api * format * Fix formatting * Fix dependencies * Fix syntax * Cleanup doc and warnings * Faster tests * Higher budget for HER perf test (revert prev change) * Fixes and update doc * Fix doc build * Fix breaking change * Fixes for rendering * Rename variables in monitor * update render method for gym 0.26 API backwards compatible (mode argument is allowed) while using the gym 0.26 API (render mode is determined at environment creation) * update tests and docs to new gym render API * undo removal of render modes metatadata check * set rgb_array as default render mode for gym.make * undo changes & raise warning if not 'rgb_array' * Fix type check * Remove recursion and fix type checking * Remove hacks for protobuf and gym 0.24 * Fix type annotations * reuse existing render_mode attribute * return tiled images for 'human' render mode * Allow to use opencv for human render, fix typos * Add warning when using non-zero start with Discrete (fixes #1197) * Fix type checking * Bug fixes and handle more cases * Throw proper warnings * Update test * Fix new metadata name * Ignore numpy warnings * Fixes in vec recorder * Global ignore * Filter local warning too * Monkey patch not needed for gym 26 * Add doc of VecEnv vs Gym API * Add render test * Fix return type * Update VecEnv vs Gym API doc * Fix for custom render mode * Fix return type * Fix type checking * check test env test_buffer * skip render check * check env test_dict_env * test_env test_gae * check envs in remaining tests * Update tests * Add warning for Discrete action space with non-zero (#1295) * Fix atari annotation * ignore get_action_meanings [attr-defined] * Fix mypy issues * Add patch for gym/gymnasium transition * Switch to gymnasium * Rely on signature instead of version * More patches * Type ignore because of https://github.com/Farama-Foundation/Gymnasium/pull/39 * Fix doc build * Fix pytype errors * Fix atari requirement * Update env checker due to change in dtype for Discrete * Fix type hint * Convert spaces for saved models * Ignore pytype * Remove gitlab CI * Disable pytype for convert space * Fix undefined info * Fix undefined info * Upgrade shimmy * Fix wrappers type annotation (need PR from Gymnasium) * Fix gymnasium dependency * Fix dependency declaration * Cap pygame version for python 3.7 * Point to master branch (v0.28.0) * Fix: use main not master branch * Rename done to terminated * Fix pygame dependency for python 3.7 * Rename gym to gymnasium * Update Gymnasium * Fix test * Fix tests * Forks don't have access to private variables * Fix linter warnings * Update read the doc env * Fix env checker for GoalEnv * Fix import * Update env checker (more info) and fix dtype * Use micromamab for Docker * Update dependencies * Clarify VecEnv doc * Fix Gymnasium version * Copy file only after mamba install * [ci skip] Update docker doc * Polish code * Reformat * Remove deprecated features * Ignore warning * Update doc * Update examples and changelog * Fix type annotation bundle (SAC, TD3, A2C, PPO, base class) (#1436) * Fix SAC type hints, improve DQN ones * Fix A2C and TD3 type hints * Fix PPO type hints * Fix on-policy type hints * Fix base class type annotation, do not use defaults * Update version * Disable mypy for python 3.7 * Rename Gym26StepReturn * Update continuous critic type annotation * Fix pytype complain --------- Co-authored-by: Carlos Luis <carlos.luisgonc@gmail.com> Co-authored-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com> Co-authored-by: Thomas Lips <37955681+tlpss@users.noreply.github.com> Co-authored-by: tlips <thomas.lips@ugent.be> Co-authored-by: tlpss <thomas17.lips@gmail.com> Co-authored-by: Quentin GALLOUÉDEC <gallouedec.quentin@gmail.com>
108 lines
4.1 KiB
YAML
108 lines
4.1 KiB
YAML
name: "\U0001F916 Custom Gym Environment Issue"
|
|
description: How to report an issue when using a custom Gym environment
|
|
labels: ["question", "custom gym env"]
|
|
body:
|
|
- type: markdown
|
|
attributes:
|
|
value: |
|
|
**Important Note: We do not do technical support, nor consulting** and don't answer personal questions per email.
|
|
Please post your question on the [RL Discord](https://discord.com/invite/xhfNqQv), [Reddit](https://www.reddit.com/r/reinforcementlearning/) or [Stack Overflow](https://stackoverflow.com/) in that case.
|
|
|
|
**Please check your environment first using**:
|
|
```python
|
|
from stable_baselines3.common.env_checker import check_env
|
|
|
|
env = CustomEnv(arg1, ...)
|
|
# It will check your custom environment and output additional warnings if needed
|
|
check_env(env)
|
|
```
|
|
- type: textarea
|
|
id: description
|
|
attributes:
|
|
label: 🐛 Bug
|
|
description: A clear and concise description of what the bug is.
|
|
validations:
|
|
required: true
|
|
- type: textarea
|
|
id: code-example
|
|
attributes:
|
|
label: Code example
|
|
description: |
|
|
Please try to provide a minimal example to reproduce the bug.
|
|
For a custom environment, you need to give at least the observation space, action space, `reset()` and `step()` methods (see working example below).
|
|
Error messages and stack traces are also helpful.
|
|
Please use the [markdown code blocks](https://help.github.com/en/articles/creating-and-highlighting-code-blocks) for both code and stack traces.
|
|
value: |
|
|
```python
|
|
import gym
|
|
import numpy as np
|
|
from gym import spaces
|
|
|
|
from stable_baselines3 import A2C
|
|
from stable_baselines3.common.env_checker import check_env
|
|
|
|
|
|
class CustomEnv(gym.Env):
|
|
|
|
def __init__(self):
|
|
super().__init__()
|
|
self.observation_space = spaces.Box(low=-np.inf, high=np.inf, shape=(14,))
|
|
self.action_space = spaces.Box(low=-1, high=1, shape=(6,))
|
|
|
|
def reset(self, seed=None):
|
|
return self.observation_space.sample(), {}
|
|
|
|
def step(self, action):
|
|
obs = self.observation_space.sample()
|
|
reward = 1.0
|
|
terminated = False
|
|
truncated = False
|
|
info = {}
|
|
return obs, reward, terminated, truncated, info
|
|
|
|
env = CustomEnv()
|
|
check_env(env)
|
|
|
|
model = A2C("MlpPolicy", env, verbose=1).learn(1000)
|
|
```
|
|
|
|
- type: textarea
|
|
id: traceback
|
|
attributes:
|
|
label: Relevant log output / Error message
|
|
description: Please copy and paste any relevant log output / error message. This will be automatically formatted into code, so no need for backticks.
|
|
placeholder: "Traceback (most recent call last): File ..."
|
|
render: shell
|
|
|
|
- type: textarea
|
|
id: system-info
|
|
attributes:
|
|
label: System Info
|
|
description: |
|
|
Describe the characteristic of your environment:
|
|
* Describe how the library was installed (pip, docker, source, ...)
|
|
* GPU models and configuration
|
|
* Python version
|
|
* PyTorch version
|
|
* Gym version
|
|
* Versions of any other relevant libraries
|
|
|
|
You can use `sb3.get_system_info()` to print relevant packages info:
|
|
```sh
|
|
python -c 'import stable_baselines3 as sb3; sb3.get_system_info()'
|
|
```
|
|
- type: checkboxes
|
|
id: terms
|
|
attributes:
|
|
label: Checklist
|
|
options:
|
|
- label: I have checked that there is no similar [issue](https://github.com/DLR-RM/stable-baselines3/issues) in the repo
|
|
required: true
|
|
- label: I have read the [documentation](https://stable-baselines3.readthedocs.io/en/master/)
|
|
required: true
|
|
- label: I have provided a minimal working example to reproduce the bug
|
|
required: true
|
|
- label: I have checked my env using the env checker
|
|
required: true
|
|
- label: I've used the [markdown code blocks](https://help.github.com/en/articles/creating-and-highlighting-code-blocks) for both code and stack traces.
|
|
required: true
|