mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-16 18:31:27 +00:00
27 lines
824 B
Markdown
27 lines
824 B
Markdown
|
|
---
|
||
|
|
title: Accelerate PyTorch
|
||
|
|
grand_parent: Tutorials
|
||
|
|
parent: Inferencing
|
||
|
|
nav_order: 2
|
||
|
|
---
|
||
|
|
# Accelerate PyTorch model inferencing
|
||
|
|
{: .no_toc }
|
||
|
|
|
||
|
|
ONNX Runtime can be used to accelerate PyTorch models inferencing.
|
||
|
|
|
||
|
|
## Contents
|
||
|
|
{: .no_toc }
|
||
|
|
|
||
|
|
* TOC placeholder
|
||
|
|
{:toc}
|
||
|
|
|
||
|
|
## Convert model to ONNX
|
||
|
|
|
||
|
|
* [Basic PyTorch export through torch.onnx](https://pytorch.org/docs/stable/onnx.html)
|
||
|
|
* [Super-resolution with ONNX Runtime](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html)
|
||
|
|
* [Export PyTorch model with custom ops](../tutorials/export-pytorch-model.md)
|
||
|
|
|
||
|
|
## Accelerate PyTorch model inferencing
|
||
|
|
|
||
|
|
* [Accelerate reduced size BERT model through quantization](https://github.com/microsoft/onnxruntime/blob/master/onnxruntime/python/tools/quantization/notebooks/bert/Bert-GLUE_OnnxRuntime_quantization.ipynb)
|