mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-05-16 21:00:14 +00:00
1e4b259d28
* updating examples with current api calls * Fixing capitalization in api calls, adding RKNPU update * Correcting nuphar and rknpu ep api calls * Include creating session in readme
22 lines
1 KiB
Markdown
22 lines
1 KiB
Markdown
## ArmNN Execution Provider
|
|
|
|
[ArmNN](https://github.com/ARM-software/armnn) is an open source inference engine maintained by Arm and Linaro companies. The integration of ArmNN as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores.
|
|
|
|
### Build ArmNN execution provider
|
|
For build instructions, please see the [BUILD page](../../BUILD.md#ArmNN).
|
|
|
|
### Using the ArmNN execution provider
|
|
#### C/C++
|
|
To use ArmNN as execution provider for inferencing, please register it as below.
|
|
```
|
|
Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
|
|
Ort::SessionOptions sf;
|
|
bool enable_cpu_mem_arena = true;
|
|
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ArmNN(sf, enable_cpu_mem_arena));
|
|
```
|
|
The C API details are [here](../C_API.md#c-api).
|
|
|
|
### Performance Tuning
|
|
For performance tuning, please see guidance on this page: [ONNX Runtime Perf Tuning](../ONNX_Runtime_Perf_Tuning.md)
|
|
|
|
When/if using [onnxruntime_perf_test](../../onnxruntime/test/perftest), use the flag -e armnn
|