onnxruntime/docs/tutorials/accelerate-pytorch/pytorch.md

23 lines
815 B
Markdown
Raw Normal View History

---
title: Accelerate PyTorch Inference
parent: Accelerate PyTorch
grand_parent: Tutorials
nav_order: 1
---
# Accelerate PyTorch model inferencing
{: .no_toc }
ONNX Runtime can be used to accelerate PyTorch models inferencing.
## Convert model to ONNX
{: .no_toc }
* [Basic PyTorch export through torch.onnx](https://pytorch.org/docs/stable/onnx.html)
* [Super-resolution with ONNX Runtime](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html)
* [Export PyTorch model with custom ops](../tutorials/export-pytorch-model.md)
## Accelerate PyTorch model inferencing
{: .no_toc }
* [Accelerate reduced size BERT model through quantization](https://github.com/microsoft/onnxruntime/blob/master/onnxruntime/python/tools/quantization/notebooks/bert/Bert-GLUE_OnnxRuntime_quantization.ipynb)