onnxruntime/onnxruntime/core
Ted Themistokleous 8d50313816
[Migraphx EP] Static int8 QDQ support (#17931)
### Description
<!-- Describe your changes. -->
Adding static int8 quantization support for MIGraphX Execution Provider

- Allows for parsing in calibration tables generated by Onnxruntime or
TensorRT's toolsets
- Add proper environment variables into the MIGraphX EP
- Update python API to include updating execution provider flags -> was
missing on python side
- Hook into MIGraphX's int8 quantitation and optimization of models

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

Required so that we can get onnxruntime to pass in models while
leveraging the existing tooling for int8 static QDQ quantization.

First step in a series of PRs which will add further static quantization
on the operator level as MIGraphX releases further support.

These changes drew heavily from the tensorRT EP should allow for similar
functionality for GPU based (versus CPU) quantization of models before
an inference is performed.

---------

Co-authored-by: Ted Themistokleous <tthemist@amd.com>
Co-authored-by: Ted Themistokleous <tedthemistokleous@amd.com>
2023-11-09 17:46:49 +08:00
..
codegen Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
common Add a build validation for Linux ARM64 cross-compile (#18200) 2023-11-08 13:03:18 -08:00
dll Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
dlpack Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
eager
flatbuffers Fix compilation with newer flatbuffers (#17164) 2023-08-29 10:28:26 -07:00
framework Do not run AOT function inlining when the model does not define any local functions (#18302) 2023-11-07 13:46:42 -08:00
graph GQA Flash Attention with Attention Mask (#18283) 2023-11-07 17:47:51 -08:00
language_interop_ops Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
mlas Block-wise 4b quantization matmul operator change (#18172) 2023-11-03 15:29:43 -07:00
optimizer [QNN EP] Enable Expand op (#18234) 2023-11-06 16:28:11 -08:00
platform Add a build validation for Linux ARM64 cross-compile (#18200) 2023-11-08 13:03:18 -08:00
providers [Migraphx EP] Static int8 QDQ support (#17931) 2023-11-09 17:46:49 +08:00
quantization Refactor prepack buffer code (#16280) 2023-06-08 14:42:02 -07:00
session Do not run AOT function inlining when the model does not define any local functions (#18302) 2023-11-07 13:46:42 -08:00
util Updating QDQ to support Float8E4M3FN (#16550) 2023-08-08 12:18:48 +02:00