mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-14 18:12:05 +00:00
9e8d795344
* Update ORT Mobile documentation for both the pre-built package and custom build usage Add info on pre-built package and CoreML EP Refer to operator kernels and contrib ops documentation in github so we can point to the version specific content Tweak some aspects like not specifying nav_order in places (items sort alphabetically by default) * merge previous unmerged ios doc updates * Address PR comments * Minor tweaks * Address PR comments Co-authored-by: Guoyu Wang <wanggy@outlook.com>
50 lines
No EOL
1.7 KiB
Markdown
50 lines
No EOL
1.7 KiB
Markdown
---
|
|
title: AMD MI GraphX
|
|
parent: Execution Providers
|
|
grand_parent: Reference
|
|
---
|
|
|
|
# MIGraphX Execution Provider
|
|
{: .no_toc }
|
|
|
|
The [MIGraphX](https://github.com/ROCmSoftwarePlatform/AMDMIGraphX/) execution provider uses AMD's Deep Learning graph optimization engine to accelerate ONNX model on AMD GPUs.
|
|
|
|
## Contents
|
|
{: .no_toc }
|
|
|
|
* TOC placeholder
|
|
{:toc}
|
|
|
|
## Build
|
|
For build instructions, please see the [BUILD page](../../how-to/build/eps.md#amd-migraphx).
|
|
|
|
## Usage
|
|
|
|
### C/C++
|
|
|
|
```c++
|
|
Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
|
|
Ort::SessionOptions sf;
|
|
int device_id = 0;
|
|
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_MiGraphX(sf, device_id));
|
|
```
|
|
|
|
You can check [here](https://github.com/scxiao/ort_test/tree/master/char_rnn) for a specific c/c++ program.
|
|
|
|
The C API details are [here](../api/c-api.md).
|
|
|
|
### Python
|
|
When using the Python wheel from the ONNX Runtime build with MIGraphX execution provider, it will be automatically
|
|
prioritized over the default GPU or CPU execution providers. There is no need to separately register the execution
|
|
provider. Python APIs details are [here](/python/api_summary).
|
|
|
|
You can check [here](https://github.com/scxiao/ort_test/tree/master/python/run_onnx) for a python script to run an
|
|
model on either the CPU or MIGraphX Execution Provider.
|
|
|
|
## Configuration Options
|
|
MIGraphX providers an environment variable ORT_MIGRAPHX_FP16_ENABLE to enable the FP16 mode.
|
|
|
|
## Performance Tuning
|
|
For performance tuning, please see guidance on this page: [ONNX Runtime Perf Tuning](../../how-to/tune-performance.md)
|
|
|
|
When/if using [onnxruntime_perf_test](https://github.com/microsoft/onnxruntime/tree/master/onnxruntime/test/perftest#onnxruntime-performance-test), use the flag `-e migraphx` |