mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-06-03 23:49:44 +00:00
b8a255e1b5
* Initial update of readme * Readme updates * Review of consolidated README (#3930) * Proposed updates for readme (#3953) I found some of the information was duplicated within the doc, so attempted to streamline * Fix links * More updates - fix build instructions - nodejs doc reorganization - roadmap update - version fixes * Update ORT Server build instructions * More doc cleanup * fix python dev notes name * Update nodejs and some links * sync eigen version back to master * Minor fixes * add nodsjs to sample table of content * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * address PR feedback * address PR feedback * nodejs build instruction * Update Java instructions to include gradle * Roadmap refresh Reformat some data, fix link, minor rewording * Clarify Visual C++ runtime req Co-authored-by: Nat Kershaw (MSFT) <nakersha@microsoft.com> Co-authored-by: Prasanth Pulavarthi <prasantp@microsoft.com> Co-authored-by: manashgoswami <magoswam@microsoft.com>
75 lines
No EOL
4.2 KiB
Markdown
75 lines
No EOL
4.2 KiB
Markdown
# ONNX Runtime Samples and Tutorials
|
|
|
|
Here you will find various samples, tutorials, and reference implementations for using ONNX Runtime.
|
|
For a list of available dockerfiles and published images to help with getting started, see [this page](../dockerfiles/README.md).
|
|
|
|
* [Python](#Python)
|
|
* [C#](#C)
|
|
* [C/C++](#CC)
|
|
* [Java](#Java)
|
|
* [Node.js](#Nodejs)
|
|
***
|
|
|
|
## Python
|
|
**Inference only**
|
|
* [Basic Model Inferencing (single node Sigmoid) on CPU](https://github.com/onnx/onnx-docker/blob/master/onnx-ecosystem/inference_demos/simple_onnxruntime_inference.ipynb)
|
|
* [Model Inferencing (Resnet50) on CPU](https://github.com/onnx/onnx-docker/blob/master/onnx-ecosystem/inference_demos/resnet50_modelzoo_onnxruntime_inference.ipynb)
|
|
* [Model Inferencing on CPU](https://github.com/onnx/onnx-docker/tree/master/onnx-ecosystem/inference_demos) using [ONNX-Ecosystem Docker image](https://github.com/onnx/onnx-docker/tree/master/onnx-ecosystem)
|
|
* [Model Inferencing on CPU using ONNX Runtime Server (SSD Single Shot MultiBox Detector)](https://github.com/onnx/tutorials/blob/master/tutorials/OnnxRuntimeServerSSDModel.ipynb)
|
|
* [Model Inferencing using NUPHAR Execution Provider](../docs/python/notebooks/onnxruntime-nuphar-tutorial.ipynb)
|
|
|
|
**Inference with model conversion**
|
|
* [SKL Pipeline: Train, Convert, and Inference](https://microsoft.github.io/onnxruntime/python/tutorial.html)
|
|
* [Keras: Convert and Inference](https://microsoft.github.io/onnxruntime/python/auto_examples/plot_dl_keras.html#sphx-glr-auto-examples-plot-dl-keras-py)
|
|
|
|
**Inference and deploy through AzureML**
|
|
* Inferencing on CPU using [ONNX Model Zoo](https://github.com/onnx/models) models:
|
|
* [Facial Expression Recognition](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/deployment/onnx/onnx-inference-facial-expression-recognition-deploy.ipynb)
|
|
* [MNIST Handwritten Digits](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/deployment/onnx/onnx-inference-mnist-deploy.ipynb)
|
|
* [Resnet50 Image Classification](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/deployment/onnx/onnx-modelzoo-aml-deploy-resnet50.ipynb)
|
|
* Inferencing on CPU with model conversion step for existing models:
|
|
* [TinyYolo](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/deployment/onnx/onnx-convert-aml-deploy-tinyyolo.ipynb)
|
|
* Inferencing on CPU with PyTorch model training:
|
|
* [MNIST](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/deployment/onnx/onnx-train-pytorch-aml-deploy-mnist.ipynb)
|
|
|
|
*For aditional information on training in AzureML, please see [AzureML Training Notebooks](https://github.com/Azure/MachineLearningNotebooks/tree/master/how-to-use-azureml/training)*
|
|
|
|
* Inferencing on GPU with TensorRT Execution Provider (AKS)
|
|
* [FER+](../docs/python/notebooks/onnx-inference-byoc-gpu-cpu-aks.ipynb)
|
|
|
|
**Inference and Deploy wtih Azure IoT Edge**
|
|
* [Intel OpenVINO](http://aka.ms/onnxruntime-openvino)
|
|
* [NVIDIA TensorRT on Jetson Nano (ARM64)](http://aka.ms/onnxruntime-arm64)
|
|
* [ONNX Runtime with Azure ML](https://github.com/Azure-Samples/onnxruntime-iot-edge/blob/master/AzureML-OpenVINO/README.md)
|
|
|
|
**Other**
|
|
* [Running ONNX model tests](./docs/Model_Test.md)
|
|
* [Common Errors with explanations](https://microsoft.github.io/onnxruntime/python/auto_examples/plot_common_errors.html#sphx-glr-auto-examples-plot-common-errors-py)
|
|
|
|
## C#
|
|
* [Inferencing Tutorial](../docs/CSharp_API.md#getting-started)
|
|
|
|
## C/C++
|
|
* [C - Inferencing (SqueezeNet)](../csharp/test/Microsoft.ML.OnnxRuntime.EndToEndTests.Capi/C_Api_Sample.cpp)
|
|
* [C++ - Inferencing (SqueezeNet)](../csharp/test/Microsoft.ML.OnnxRuntime.EndToEndTests.Capi/CXX_Api_Sample.cpp)
|
|
* [C++ - Inferencing (MNIST)](./c_cxx/MNIST)
|
|
|
|
## Java
|
|
* [Inference Tutorial](../docs/Java_API.md#getting-started)
|
|
* [MNIST inference](../java/src/test/java/sample/ScoreMNIST.java)
|
|
|
|
## Node.js
|
|
* [Basic Usage](./nodejs/01_basic-usage)
|
|
* [Create Tensor](./nodejs/01_basic-usage)
|
|
* [Create InferenceSession](./nodejs/01_basic-usage)
|
|
<!--
|
|
### [03 Create Tensor (Advanced)](./03_create-tensor-advanced/README.md)
|
|
|
|
This example is a demonstration of advanced usage of creating tensors.
|
|
-->
|
|
|
|
In each example's implementation subdirectory, run
|
|
```
|
|
npm install
|
|
node ./
|
|
``` |