pytorch/benchmarks
Bin Bao f7cdd3a7a0 [inductor] Use a large tolerance for botnet26t_256 (#90383)
Summary: botnet26t_256 shows random tolerance failure on CI. The root
cause of this randomness is still to-be-invesitgated, but let's use a
larger tolerance for now.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/90383
Approved by: https://github.com/ezyang
2022-12-07 19:35:06 +00:00
..
cpp [NVFuser] Upstream push 1026 (#87779) 2022-11-04 20:04:34 +00:00
distributed Fix typos under benchmarks, test, and tools directories (#87975) 2022-10-29 01:26:17 +00:00
dynamo [inductor] Use a large tolerance for botnet26t_256 (#90383) 2022-12-07 19:35:06 +00:00
fastrnns
framework_overhead_benchmark
functional_autograd_benchmark Fix exception causes all over the codebase (#90271) 2022-12-07 04:29:00 +00:00
fuser
instruction_counts Fix typos under benchmarks, test, and tools directories (#87975) 2022-10-29 01:26:17 +00:00
nested Use tensor cores for NT bmm (#86856) 2022-11-02 21:51:40 +00:00
operator_benchmark Fix typos under benchmarks, test, and tools directories (#87975) 2022-10-29 01:26:17 +00:00
overrides_benchmark
profiler_benchmark
record_function_benchmark
serialization
sparse
static_runtime Back out "[static-runtime] change the backend for permute_copy" (#89463) 2022-11-22 06:26:10 +00:00
tensorexpr
transformer Update sdp dispatch logic to enable fused backward (#89154) 2022-11-21 20:02:09 +00:00
compare-fastrnn-results.py
compare.sh
README.md
upload_scribe.py

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite