mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-13 18:08:13 +00:00

Update documentation for Arm Compute Library (#22232 )

### Description
This PR updates the documentation regarding the ACL execution provider
to reflect the changes made in #22032.
It also updates various references to Arm's trademarks in accordance
with the Arm trademark use guidelines.



### Motivation and Context
Ensures documentation is accurate following recent changes.

---------

Signed-off-by: Michael Tyler <michael.tyler@arm.com>

2024-09-30 18:56:27 -07:00

1.2 KiB

Raw Blame History

title	description	grand_parent	parent	nav_order	redirect_from
Arm - Arm NN	Instructions to execute ONNX Runtime with Arm NN on Armv8 cores	Execution Providers	Community-maintained	2	/docs/reference/execution-providers/ArmNN-ExecutionProvider

Arm NN Execution Provider

{: .no_toc}

{: .no_toc }

TOC placeholder {:toc}

Accelerate performance of ONNX model workloads across Arm®-based devices with the Arm NN execution provider. Arm NN is an open source inference engine maintained by Arm and Linaro companies.

Build

For build instructions, please see the BUILD page.

Usage

C/C++

To use Arm NN as execution provider for inferencing, please register it as below.

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions so;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ArmNN(so, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

When/if using onnxruntime_perf_test, use the flag -e armnn

1.2 KiB Raw Blame History