saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-20 19:12:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add option to enable FP16 precision for QNN EP (#19971)

Browse source 
add option to enable FP16 precision for QNN EP
This commit is contained in:
Hector Li 2024-03-18 15:58:17 -07:00 committed by GitHub
parent ad3653dbfc
commit 6f9c0a2fe7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 5 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
docs/execution-providers/QNN-ExecutionProvider.md
View file

@ -114,6 +114,11 @@ Alternatively to setting profiling_level at compile time, profiling can be enabl
|---|---|
|Device ID (string)|The ID of the device to use when setting `htp_arch`. Defaults to "0" (for single device).|
|`"enable_htp_fp16_precision"`|Description [Example](https://github.com/microsoft/onnxruntime-inference-examples/tree/main/c_cxx/QNN_EP/mobilenetv2_classification)|
|---|---|
|'0'|default.|
|'1'|Enable the float32 model to be inferenced with fp16 precision.|
## Supported ONNX operators
|Operator|Notes|