mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-14 18:12:05 +00:00
* initial setup and rename "how to" to "setup" * move API to main nav * move api to main nav * add get starated, rework nav order * rename to install move mds out of install section * update api nav and home page * add install docs and python qs updates * python get started work * remove c and obj c for now * move java, python, and obj-c docs under api folder * move java api html to iframe (ugh) * remove api docs w/o details, move api text getstar * remove api docs wo detail updates get started * remvoe iframes * move eco system to main nav * fix api buttons * added more examples moved intro to ORT * fix links * fix get started titles * fix get started titles * fix more links * fix more links * more link fixes * fix nav remove inferencing and training subnav * fix top nav remove inference and training nav * fix title * fix tutorials nav hierarchy * fix python api button * add tenorflow keras example * fix quickstart toc * add imports fix spacing * fix links * update nav and python get started page * move ort training example, add coming soon for iot * update C# get started * fix spacing on quantization * Add some js get started content * fix formatting * fix typo * removed onnx-pytorch and onnx-tf * updated pip install torch and added links iot page * added pytorch tutorial heirarchy * updated web to docs soon added release blog link * add web link
22 lines
815 B
Markdown
22 lines
815 B
Markdown
---
|
|
title: Accelerate PyTorch Inference
|
|
parent: Accelerate PyTorch
|
|
grand_parent: Tutorials
|
|
nav_order: 1
|
|
---
|
|
# Accelerate PyTorch model inferencing
|
|
{: .no_toc }
|
|
|
|
ONNX Runtime can be used to accelerate PyTorch models inferencing.
|
|
|
|
## Convert model to ONNX
|
|
{: .no_toc }
|
|
|
|
* [Basic PyTorch export through torch.onnx](https://pytorch.org/docs/stable/onnx.html)
|
|
* [Super-resolution with ONNX Runtime](https://pytorch.org/tutorials/advanced/super_resolution_with_onnxruntime.html)
|
|
* [Export PyTorch model with custom ops](../tutorials/export-pytorch-model.md)
|
|
|
|
## Accelerate PyTorch model inferencing
|
|
{: .no_toc }
|
|
|
|
* [Accelerate reduced size BERT model through quantization](https://github.com/microsoft/onnxruntime/blob/master/onnxruntime/python/tools/quantization/notebooks/bert/Bert-GLUE_OnnxRuntime_quantization.ipynb)
|