saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/execution-providers/community-maintained/ACL-ExecutionProvider.md
Faith Xu 3681048474
[Docs] Update performance sections (#15071) 
### Description
Staged: https://faxu.github.io/onnxruntime/docs/performance/

Main changes:
- Restructure performance section to break into sub-categories
- Move CUDA specific perf tuning tips to [CUDA EP
page](https://faxu.github.io/onnxruntime/docs/execution-providers/CUDA-ExecutionProvider.html#performance-tuning)
- Update [Transformer optimizer
page](https://faxu.github.io/onnxruntime/docs/performance/transformers-optimization.html)
to remove version-specific content... will be supported along with
https://github.com/microsoft/onnxruntime/pull/14964
- Fix links to point to new pages
2023-03-17 15:39:22 -07:00

1.2 KiB
Raw Blame History

title description grand_parent parent nav_order redirect_from
Arm - ACL Instructions to execute ONNX Runtime with the ACL Execution Provider Execution Providers Community-maintained 2 /docs/reference/execution-providers/ACL-ExecutionProvider

ACL Execution Provider

{: .no_toc }

The integration of ACL as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores. Arm Compute Library{:target="_blank"} is an open source inference engine maintained by Arm and Linaro companies.

Contents

{: .no_toc }

  • TOC placeholder {:toc}

Build

For build instructions, please see the build page.

Usage

C/C++

{: .no_toc }

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions sf;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ACL(sf, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

When/if using onnxruntime_perf_test{:target="_blank"}, use the flag -e acl