saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/reference/execution-providers/ACL-ExecutionProvider.md
Edward Chen da44699790
EP documentation updates (#6253) 
* Add CUDA EP documentation file.

* Update nav_orders.

* Address PR comments, update.

* Remove usage of set_nuphar_settings().

* Add default values of configuration options.
2021-01-13 13:11:53 -08:00

1.1 KiB
Raw Blame History

title parent grand_parent nav_order
ARM Compute Library (ACL) Execution Providers Reference 8

ACL Execution Provider

Arm Compute Library is an open source inference engine maintained by Arm and Linaro companies. The integration of ACL as an execution provider (EP) into ONNX Runtime accelerates performance of ONNX model workloads across Armv8 cores.

Build ACL execution provider

For build instructions, please see the BUILD page.

Using the ACL execution provider

C/C++

Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
Ort::SessionOptions sf;
bool enable_cpu_mem_arena = true;
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_ACL(sf, enable_cpu_mem_arena));

The C API details are here.

Performance Tuning

For performance tuning, please see guidance on this page: ONNX Runtime Perf Tuning

When/if using onnxruntime_perf_test, use the flag -e acl