pytorch/benchmarks
Akshay Parashar 38169c2287 [Static Runtime] Fix precision error in test cases (#80935)
Summary:
- Test cases related to DeepAndWideSciptModel() was crashing at random due to precision issue
- test cases related for precision: DeepWide, KWargsAPI_1, KWargsAPI_2, KWargsAPI_Optional, FusionPass
- test failure was not observed always due to random input to the model (via torch::randn)
- Increasing the absolute tolerance for test cases

Differential Revision: D37639067

Pull Request resolved: https://github.com/pytorch/pytorch/pull/80935
Approved by: https://github.com/mikeiovine
2022-07-06 16:31:18 +00:00
..
cpp [nvfuser_upstream_push] Reland: nvfuser code base bump 060822 (#79406) 2022-06-16 17:52:21 +00:00
distributed Fix some typos. 2022-04-11 21:55:59 +00:00
fastrnns [libkineto] Re-enable user-annotations in PyTorch (#75601) 2022-04-26 23:54:22 +00:00
framework_overhead_benchmark
functional_autograd_benchmark Added functorch to functional_autograd_benchmark 2022-04-22 14:04:26 +00:00
fuser
instruction_counts [lint] upgrade mypy to latest version 2022-05-03 20:51:34 +00:00
operator_benchmark [TorchArrow][AIBench] Add AIBench Metrics for TorchArrow Inference Benchmark Test (#75035) 2022-04-01 00:35:42 +00:00
overrides_benchmark
profiler_benchmark
record_function_benchmark
serialization
sparse
static_runtime [Static Runtime] Fix precision error in test cases (#80935) 2022-07-06 16:31:18 +00:00
tensorexpr Fix some typos. 2022-04-11 21:55:59 +00:00
compare-fastrnn-results.py
compare.sh
README.md
upload_scribe.py

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite