onnxruntime/onnxruntime
Adrian Lizarraga b47e1e64d7
[QNN EP] Make offloading graph input/output quantization (to CPU) the default (#23368)
### Description
Makes the QNN provider option `offload_graph_io_quantization` enabled by
default. It was previously disabled by default.



### Motivation and Context
Enabling this option significantly decreases inference latency for many
models.
2025-02-04 11:42:46 -08:00
..
contrib_ops DP4AMatMul perf refinements (#23539) 2025-01-31 10:20:01 -08:00
core [QNN EP] Make offloading graph input/output quantization (to CPU) the default (#23368) 2025-02-04 11:42:46 -08:00
lora Accomodate BE platforms. Make sure we always write flatbuffers LE (#22375) 2024-10-11 09:14:44 -07:00
python [EP Perf] Update env to ubuntu 22.04 (#23570) 2025-02-03 17:35:33 -08:00
test [QNN EP] Make offloading graph input/output quantization (to CPU) the default (#23368) 2025-02-04 11:42:46 -08:00
tool/etw
wasm [WebNN] Fixed WebNN Module undefined issue (#22795) 2024-11-11 21:31:24 -08:00
__init__.py Use ruff as the formatter to replace black-isort (#23397) 2025-01-16 11:14:15 -08:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings