mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00

History

diwei sun 2d1ad0c31a [CI] Add freezing for cpu inductor accuracy test in inductor CI (#124715 ) This PR is to enable '--freezing' when running dynamo accuracy check in CI. Backgroud: ISSUES[#124286](https://github.com/pytorch/pytorch/issues/124286) is not captured by CI since freezing is not enabled for cpu-inductor. Pull Request resolved: https://github.com/pytorch/pytorch/pull/124715 Approved by: https://github.com/chuanqi129, https://github.com/jgong5, https://github.com/atalman, https://github.com/desertfire		2024-06-03 07:37:30 +00:00
..
distributed	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
dynamo	[CI] Add freezing for cpu inductor accuracy test in inductor CI (#124715 )	2024-06-03 07:37:30 +00:00
fastrnns	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
framework_overhead_benchmark	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
functional_autograd_benchmark	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
fuser	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
gpt_fast	[GPT-fast benchmark] Merge GPT-fast and micro benchmark output as one CSV file (#127586 )	2024-05-31 18:50:49 +00:00
inference	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
instruction_counts	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
nested
operator_benchmark	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
overrides_benchmark	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
profiler_benchmark	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
record_function_benchmark
serialization	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
sparse	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
static_runtime
tensorexpr	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
transformer	[5/N][Easy] fix typo for `usort` config in `pyproject.toml` (`kown` -> `known`): sort torch (#127126 )	2024-05-27 14:49:57 +00:00
compare-fastrnn-results.py
compare.sh
README.md
upload_scribe.py

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: