mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-15 18:23:41 +00:00
* update cuda/trt versions * update API doc links * remove api doc parentage * fix menu * fix broken links * open api links in new window
22 lines
797 B
Markdown
22 lines
797 B
Markdown
---
|
|
title: Accelerate PyTorch Inference
|
|
parent: Accelerate PyTorch
|
|
grand_parent: Tutorials
|
|
nav_order: 1
|
|
---
|
|
# Accelerate PyTorch model inferencing
|
|
{: .no_toc }
|
|
|
|
ONNX Runtime can be used to accelerate PyTorch models inferencing.
|
|
|
|
## Convert model to ONNX
|
|
{: .no_toc }
|
|
|
|
* [Basic PyTorch export through torch.onnx](https://pytorch.org/docs/stable/onnx.html)
|
|
* [Super-resolution with ONNX Runtime](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html)
|
|
* [Export PyTorch model with custom ops](../export-pytorch-model.md)
|
|
|
|
## Accelerate PyTorch model inferencing
|
|
{: .no_toc }
|
|
|
|
* [Accelerate reduced size BERT model through quantization](https://github.com/microsoft/onnxruntime-inference-examples/blob/main/quantization/notebooks/bert/Bert-GLUE_OnnxRuntime_quantization.ipynb)
|