pytorch/benchmarks
2025-02-09 07:33:44 +00:00
..
distributed 2025-01-05 nightly release (f2d6cfa677) 2025-01-05 07:33:47 +00:00
dynamo 2025-02-09 nightly release (6a9a02acbe) 2025-02-09 07:33:44 +00:00
fastrnns 2025-01-19 nightly release (8cc415774f) 2025-01-19 07:33:43 +00:00
framework_overhead_benchmark 2024-12-12 nightly release (1dd6f21029) 2024-12-12 07:35:13 +00:00
functional_autograd_benchmark 2025-01-19 nightly release (8cc415774f) 2025-01-19 07:33:43 +00:00
fuser 2024-12-12 nightly release (1dd6f21029) 2024-12-12 07:35:13 +00:00
gpt_fast 2025-01-22 nightly release (f2cfe8b59f) 2025-01-22 07:34:05 +00:00
inference 2024-07-18 nightly release (874bbc53c9) 2024-07-18 07:33:37 +00:00
instruction_counts 2025-01-19 nightly release (8cc415774f) 2025-01-19 07:33:43 +00:00
nested 2024-12-12 nightly release (1dd6f21029) 2024-12-12 07:35:13 +00:00
operator_benchmark 2025-01-27 nightly release (b75afa2e2e) 2025-01-27 07:33:54 +00:00
overrides_benchmark 2024-07-18 nightly release (874bbc53c9) 2024-07-18 07:33:37 +00:00
profiler_benchmark 2024-12-24 nightly release (6ccb8ed186) 2024-12-24 07:33:51 +00:00
record_function_benchmark 2024-06-07 nightly release (65aa16f968) 2024-06-07 07:33:43 +00:00
serialization 2024-12-12 nightly release (1dd6f21029) 2024-12-12 07:35:13 +00:00
sparse 2024-12-12 nightly release (1dd6f21029) 2024-12-12 07:35:13 +00:00
static_runtime 2024-12-13 nightly release (ceb664aca6) 2024-12-13 07:34:15 +00:00
tensorexpr 2024-12-25 nightly release (c0d710634f) 2024-12-25 07:33:52 +00:00
transformer 2025-01-19 nightly release (8cc415774f) 2025-01-19 07:33:43 +00:00
compare-fastrnn-results.py 2024-07-18 nightly release (874bbc53c9) 2024-07-18 07:33:37 +00:00
compare.sh
README.md
upload_scribe.py

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: