* initial setup and rename "how to" to "setup" * move API to main nav * move api to main nav * add get starated, rework nav order * rename to install move mds out of install section * update api nav and home page * add install docs and python qs updates * python get started work * remove c and obj c for now * move java, python, and obj-c docs under api folder * move java api html to iframe (ugh) * remove api docs w/o details, move api text getstar * remove api docs wo detail updates get started * remvoe iframes * move eco system to main nav * fix api buttons * added more examples moved intro to ORT * fix links * fix get started titles * fix get started titles * fix more links * fix more links * more link fixes * fix nav remove inferencing and training subnav * fix top nav remove inference and training nav * fix title * fix tutorials nav hierarchy * fix python api button * add tenorflow keras example * fix quickstart toc * add imports fix spacing * fix links * update nav and python get started page * move ort training example, add coming soon for iot * update C# get started * fix spacing on quantization * Add some js get started content * fix formatting * fix typo * removed onnx-pytorch and onnx-tf * updated pip install torch and added links iot page * added pytorch tutorial heirarchy * updated web to docs soon added release blog link * add web link
3.5 KiB
| title | parent | grand_parent | has_children | nav_order |
|---|---|---|---|---|
| Initial setup | Deploy ONNX Runtime Mobile | Tutorials | false | 2 |
{::options toc_levels="2..3" /}
Contents
{: .no_toc}
- TOC {:toc}
Initial setup if using a pre-built package
Android
Java/Kotlin
In your Android Studio Project, make the following changes to:
-
build.gradle (Project):
repositories { mavenCentral() } -
build.gradle (Module):
dependencies { implementation 'com.microsoft.onnxruntime:onnxruntime-mobile:<onnxruntime mobile version>' }
C/C++
Download the onnxruntime-mobile AAR hosted at MavenCentral, change the file extension from .aar to .zip, and unzip it. Include the header files from the headers folder, and the relevant libonnxruntime.so dynamic library from the jni folder in your NDK project.
iOS
In your CocoaPods Podfile, add the onnxruntime-mobile-c or onnxruntime-mobile-objc pod depending on which API you wish to use.
C/C++
use_frameworks!
pod 'onnxruntime-mobile-c'
Objective-C
use_frameworks!
pod 'onnxruntime-mobile-objc'
Run pod install.
Install ONNX Runtime python package
Install the onnxruntime python package from https://pypi.org/project/onnxruntime/ in order to convert models from ONNX format to the internal ORT format. Version v1.8 or higher is required.
pip install onnxruntimewill install the latest release
Initial setup if performing a custom build
Clone ONNX Runtime repository
Use git to clone the ONNX Runtime repository
git clone --recursive https://github.com/Microsoft/onnxruntime- this will create an 'onnxruntime' directory with the repository contents
- See the Build for inferencing documentation for further details on supported environments. Ignore the build instructions on that page as they are for a full build and we will cover the mobile build instructions here.
Select the branch you wish to use. The latest release is recommended.
git checkout <branch>- e.g.
git checkout rel-1.8.0
- e.g.
It is suggested you do not use the unreleased 'master' branch unless there is a specific new feature you require.
| Release | Date | Branch | |---------|--------| | 1.8 | 2021-06-02 | rel-1.8.0 | | 1.7 | 2021-03-03 | rel-1.7.2 | | 1.6 | 2020-12-11 | rel-1.6.0 | | 1.5 | 2020-10-30 | rel-1.5.3 | | Unreleased | | master |
The directory the ONNX Runtime repository was cloned into is referred to as <ONNX Runtime repository root> in this documentation.
Install ONNX Runtime python package
Install the onnxruntime python package from https://pypi.org/project/onnxruntime/ in order to convert models from ONNX format to the internal ORT format. Version 1.5.3 or higher is required.
pip install onnxruntimewill install the latest release
You must match the python package version to the branch of the ONNX Runtime repository you checked out
- e.g. if you wanted to use the 1.7 release
git checkout rel-1.7.2in your local git repositorypip install onnxruntime==1.7.2
If you are using the master branch in the git repository you should use the nightly ONNX Runtime python package
pip install -U -i https://test.pypi.org/simple/ ort-nightly