mirror of
https://github.com/saymrwulf/stable-baselines3.git
synced 2026-05-14 20:58:03 +00:00
dd6e361204
* Added working her version, Online sampling is missing. * Updated test_her. * Added first version of online her sampling. Still problems with tensor dimensions. * Reformat * Fixed tests * Added some comments. * Updated changelog. * Add missing init file * Fixed some small bugs. * Reduced arguments for HER, small changes. * Added getattr. Fixed bug for online sampling. * Updated save/load funtions. Small changes. * Added her to init. * Updated save method. * Updated her ratio. * Move obs_wrapper * Added DQN test. * Fix potential bug * Offline and online her share same sample_goal function. * Changed lists into arrays. * Updated her test. * Fix online sampling * Fixed action bug. Updated time limit for episodes. * Updated convert_dict method to take keys as arguments. * Renamed obs dict wrapper. * Seed bit flipping env * Remove get_episode_dict * Add fast online sampling version * Added documentation. * Vectorized reward computation * Vectorized goal sampling * Update time limit for episodes in online her sampling. * Fix max episode length inference * Bug fix for Fetch envs * Fix for HER + gSDE * Reformat (new black version) * Added info dict to compute new reward. Check her_replay_buffer again. * Fix info buffer * Updated done flag. * Fixes for gSDE * Offline her version uses now HerReplayBuffer as episode storage. * Fix num_timesteps computation * Fix get torch params * Vectorized version for offline sampling. * Modified offline her sampling to use sample method of her_replay_buffer * Updated HER tests. * Updated documentation * Cleanup docstrings * Updated to review comments * Fix pytype * Update according to review comments. * Removed random goal strategy. Updated sample transitions. * Updated migration. Removed time signal removal. * Update doc * Fix potential load issue * Add VecNormalize support for dict obs * Updated saving/loading replay buffer for HER. * Fix test memory usage * Fixed save/load replay buffer. * Fixed save/load replay buffer * Fixed transition index after loading replay buffer in online sampling * Better error handling * Add tests for get_time_limit * More tests for VecNormalize with dict obs * Update doc * Improve HER description * Add test for sde support * Add comments * Add comments * Remove check that was always valid * Fix for terminal observation * Updated buffer size in offline version and reset of HER buffer * Reformat * Update doc * Remove np.empty + add doc * Fix loading * Updated loading replay buffer * Separate online and offline sampling + bug fixes * Update tensorboard log name * Version bump * Bug fix for special case Co-authored-by: Antonin Raffin <antonin.raffin@dlr.de> Co-authored-by: Antonin RAFFIN <antonin.raffin@ensta.org>
62 lines
1.3 KiB
Makefile
62 lines
1.3 KiB
Makefile
SHELL=/bin/bash
|
|
LINT_PATHS=stable_baselines3/ tests/ docs/conf.py setup.py
|
|
|
|
pytest:
|
|
./scripts/run_tests.sh
|
|
|
|
type:
|
|
pytype -j auto
|
|
|
|
lint:
|
|
# stop the build if there are Python syntax errors or undefined names
|
|
# see https://lintlyci.github.io/Flake8Rules/
|
|
flake8 ${LINT_PATHS} --count --select=E9,F63,F7,F82 --show-source --statistics
|
|
# exit-zero treats all errors as warnings.
|
|
flake8 ${LINT_PATHS} --count --exit-zero --statistics
|
|
|
|
format:
|
|
# Sort imports
|
|
isort ${LINT_PATHS}
|
|
# Reformat using black
|
|
black -l 127 ${LINT_PATHS}
|
|
|
|
check-codestyle:
|
|
# Sort imports
|
|
isort --check ${LINT_PATHS}
|
|
# Reformat using black
|
|
black --check -l 127 ${LINT_PATHS}
|
|
|
|
commit-checks: format type lint
|
|
|
|
doc:
|
|
cd docs && make html
|
|
|
|
spelling:
|
|
cd docs && make spelling
|
|
|
|
clean:
|
|
cd docs && make clean
|
|
|
|
# Build docker images
|
|
# If you do export RELEASE=True, it will also push them
|
|
docker: docker-cpu docker-gpu
|
|
|
|
docker-cpu:
|
|
./scripts/build_docker.sh
|
|
|
|
docker-gpu:
|
|
USE_GPU=True ./scripts/build_docker.sh
|
|
|
|
# PyPi package release
|
|
release:
|
|
python setup.py sdist
|
|
python setup.py bdist_wheel
|
|
twine upload dist/*
|
|
|
|
# Test PyPi package release
|
|
test-release:
|
|
python setup.py sdist
|
|
python setup.py bdist_wheel
|
|
twine upload --repository-url https://test.pypi.org/legacy/ dist/*
|
|
|
|
.PHONY: clean spelling doc lint format check-codestyle commit-checks
|