mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-14 18:12:05 +00:00
3c9ca35f93
* Edgchen1/objc api reference 1.9 (#1) * Update Objective-C API reference for 1.9. * Update spelling. * Test link changes. * Fix links. * Fix links and updates in mobile-performance-tuning.md. * Fix links in tutorials/mobile/custom-build.md. * Fix * Fix * Fix links in docs/tutorials/mobile/initial-setup.md. * Fix links. * Update note. * Add 1.9 op type support page. * Add nav info to page. * Rename files to not have spaces.
52 lines
1.5 KiB
Markdown
52 lines
1.5 KiB
Markdown
---
|
|
title: Model Execution
|
|
parent: Deploy ONNX Runtime Mobile
|
|
grand_parent: Tutorials
|
|
has_children: false
|
|
nav_order: 5
|
|
---
|
|
{::options toc_levels="2..4" /}
|
|
|
|
# Executing an ORT format model
|
|
|
|
The API for executing ORT format models is the same as for ONNX models.
|
|
|
|
See the [ONNX Runtime API documentation](../../api) for details on individual API usage.
|
|
|
|
## APIs by platform
|
|
|
|
|
|
| Platform | Available APIs |
|
|
|----------|----------------|
|
|
| Android | C, C++, Java |
|
|
| iOS | C, C++, Objective-C (Swift via bridge) |
|
|
|
|
## ORT format model loading
|
|
|
|
If you provide a filename for the ORT format model, a file extension of '.ort' will be inferred to be an ORT format model.
|
|
|
|
If you provide in-memory bytes for the ORT format model, a marker in those bytes will be checked to infer if it's an ORT format model.
|
|
|
|
If you wish to explicitly say that the InferenceSession input is an ORT format model you can do so via SessionOptions, although this generally should not be necessary.
|
|
|
|
C++ API
|
|
```c++
|
|
Ort::SessionOptions session_options;
|
|
session_options.AddConfigEntry('session.load_model_format', 'ORT');
|
|
|
|
Ort::Env env;
|
|
Ort::Session session(env, <path to model>, session_options);
|
|
```
|
|
|
|
Java API
|
|
```java
|
|
SessionOptions session_options = new SessionOptions();
|
|
session_options.addConfigEntry("session.load_model_format", "ORT");
|
|
|
|
OrtEnvironment env = OrtEnvironment.getEnvironment();
|
|
OrtSession session = env.createSession(<path to model>, opsession_optionstions);
|
|
```
|
|
|
|
------
|
|
|
|
Next: [Using NNAPI and CoreML with ORT Mobile](./using-nnapi-coreml-with-ort-mobile.md)
|