saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/execution-providers/community-maintained/ACL-ExecutionProvider.md

1.3 KiB
Raw Blame History

title description grand_parent parent nav_order redirect_from
Arm - ACL Instructions to execute ONNX Runtime with the ACL Execution Provider Execution Providers Community-maintained 2 /docs/reference/execution-providers/ACL-ExecutionProvider

ACL Execution Provider

{: .no_toc }

The integration of ACL as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores. Arm Compute Library{:target="_blank"} is an open source inference engine maintained by Arm and Linaro companies.

Contents

{: .no_toc }

  • TOC placeholder {:toc}

Build

For build instructions, please see the build page.

Usage

C/C++

{: .no_toc }

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions sf;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ACL(sf, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

For performance tuning, please see guidance on this page: ONNX Runtime Perf Tuning

When/if using onnxruntime_perf_test{:target="_blank"}, use the flag -e acl