mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-14 18:12:05 +00:00
7fd9523934
#### Description This PR adds docs of Ascend CANN excution provider. #### Changes - Preview Github page: [https://fffrog.github.io/](https://fffrog.github.io/) - Add onnxruntime build with CANN: [https://fffrog.github.io/docs/build/eps.html#cann](https://fffrog.github.io/docs/build/eps.html#cann) - Add CANN ExecutionProvider Page: [https://fffrog.github.io/docs/execution-providers/CANN-ExecutionProvider.html](https://fffrog.github.io/docs/execution-providers/CANN-ExecutionProvider.html)
53 lines
2.1 KiB
Markdown
53 lines
2.1 KiB
Markdown
---
|
|
title: MIGraphX (AMD)
|
|
description: Instructions to execute ONNX Runtime with the AMD MIGraphX execution provider
|
|
parent: Execution Providers
|
|
nav_order: 7
|
|
redirect_from: /docs/reference/execution-providers/MIGraphX-ExecutionProvider
|
|
---
|
|
|
|
# MIGraphX Execution Provider
|
|
{: .no_toc }
|
|
|
|
The [MIGraphX](https://github.com/ROCmSoftwarePlatform/AMDMIGraphX/) execution provider uses AMD's Deep Learning graph optimization engine to accelerate ONNX model on AMD GPUs.
|
|
|
|
## Contents
|
|
{: .no_toc }
|
|
|
|
* TOC placeholder
|
|
{:toc}
|
|
|
|
## Build
|
|
For build instructions, please see the [BUILD page](../build/eps.md#amd-migraphx).
|
|
|
|
## Usage
|
|
|
|
### C/C++
|
|
|
|
```c++
|
|
Ort::Env env = Ort::Env{ORT_LOGGING_LEVEL_ERROR, "Default"};
|
|
Ort::SessionOptions sf;
|
|
int device_id = 0;
|
|
Ort::ThrowOnError(OrtSessionOptionsAppendExecutionProvider_MiGraphX(sf, device_id));
|
|
```
|
|
|
|
You can check [here](https://github.com/scxiao/ort_test/tree/master/char_rnn) for a specific c/c++ program.
|
|
|
|
The C API details are [here](../get-started/with-c.md).
|
|
|
|
### Python
|
|
When using the Python wheel from the ONNX Runtime build with MIGraphX execution provider, it will be automatically
|
|
prioritized over the default GPU or CPU execution providers. There is no need to separately register the execution
|
|
provider. Python APIs details are [here](https://onnxruntime.ai/docs/api/python/api_summary.html).
|
|
*Note that the next release (ORT 1.10) will require explicitly setting the providers parameter if you want to use execution provider other than the default CPU provider when instantiating InferenceSession.*
|
|
|
|
You can check [here](https://github.com/scxiao/ort_test/tree/master/python/run_onnx) for a python script to run an
|
|
model on either the CPU or MIGraphX Execution Provider.
|
|
|
|
## Configuration Options
|
|
MIGraphX providers an environment variable ORT_MIGRAPHX_FP16_ENABLE to enable the FP16 mode.
|
|
|
|
## Performance Tuning
|
|
For performance tuning, please see guidance on this page: [ONNX Runtime Perf Tuning](../performance/tune-performance.md)
|
|
|
|
When/if using [onnxruntime_perf_test](https://github.com/microsoft/onnxruntime/tree/master/onnxruntime/test/perftest#onnxruntime-performance-test), use the flag `-e migraphx`
|