pytorch/benchmarks
chronos_secgrp_pytorch_oss_ci_oncall 32808706c5 2022-04-28 nightly release (177ea46332)
2022-04-28 00:02:33 -07:00
..
cpp 2022-04-26 nightly release (e48b29b1fb) 2022-04-26 00:02:30 -07:00
distributed 2022-04-12 nightly release (25aa251f37) 2022-04-12 00:02:37 -07:00
fastrnns 2022-04-28 nightly release (177ea46332) 2022-04-28 00:02:33 -07:00
framework_overhead_benchmark 2020-09-17 nightly release (b6f4bb0a70) 2020-09-17 00:02:40 -07:00
functional_autograd_benchmark 2022-04-23 nightly release (2f2158ae45) 2022-04-23 00:02:38 -07:00
fuser 2021-11-05 nightly release (f1754319e3) 2021-11-05 00:03:07 -07:00
instruction_counts 2021-05-14 nightly release (9b95568dc3) 2021-05-14 00:02:23 -07:00
operator_benchmark 2022-04-02 nightly release (6efc5c1acf) 2022-04-02 00:04:58 -07:00
overrides_benchmark 2021-09-18 nightly release (6707dfeefb) 2021-09-18 00:03:25 -07:00
profiler_benchmark 2020-11-26 nightly release (18ae12a841) 2020-11-26 00:05:35 -08:00
record_function_benchmark 2020-09-30 nightly release (c2c7099944) 2020-09-30 00:02:23 -07:00
serialization 2020-05-30 nightly release (b7b99ab0c8) 2020-05-30 00:02:07 -07:00
sparse 2021-04-15 nightly release (1688a5d31a) 2021-04-15 00:02:05 -07:00
static_runtime 2022-04-28 nightly release (177ea46332) 2022-04-28 00:02:33 -07:00
tensorexpr 2022-04-12 nightly release (25aa251f37) 2022-04-12 00:02:37 -07:00
compare-fastrnn-results.py 2020-09-04 nightly release (98ad5ff41f) 2020-09-04 00:02:42 -07:00
compare.sh 2020-09-04 nightly release (98ad5ff41f) 2020-09-04 00:02:42 -07:00
README.md 2021-04-15 nightly release (1688a5d31a) 2021-04-15 00:02:05 -07:00
upload_scribe.py 2020-09-09 nightly release (15cbd1cf4b) 2020-09-09 12:26:09 -07:00

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite