saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/execution-providers/ArmNN-ExecutionProvider.md
Faith Xu 6c8c8a9b12
[Docs] Update CUDA/TRT versions and menu format fixes (#9317) 
* update cuda/trt versions

* update API doc links

* remove api doc parentage

* fix menu

* fix broken links

* open api links in new window
2021-10-14 11:28:17 -07:00

1.1 KiB
Raw Blame History

title parent nav_order
ARM NN Execution Providers 3

ArmNN Execution Provider

{: .no_toc}

Contents

{: .no_toc }

  • TOC placeholder {:toc}

ArmNN is an open source inference engine maintained by Arm and Linaro companies. The integration of ArmNN as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores.

Build

For build instructions, please see the BUILD page.

Usage

C/C++

To use ArmNN as execution provider for inferencing, please register it as below.

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions so;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ArmNN(so, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

For performance tuning, please see guidance on this page: ONNX Runtime Perf Tuning

When/if using onnxruntime_perf_test, use the flag -e armnn