saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-16 18:31:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update quantization.md (#8351)

Browse source 
Spelling fix
This commit is contained in:
Justin Ormont 2021-07-14 15:41:09 -07:00 committed by GitHub
parent 52df86ac6a
commit efeca76cec
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
docs/how-to/quantization.md
View file

@ -158,7 +158,7 @@ We have 2 E2E examples [Yolo V3](https://github.com/microsoft/onnxruntime/tree/m
### Why am I not seeing performance improvements?
{: .no_toc }
Performance improvement depends on your model and hardware. Quantization performance gain comes in 2 part: instruction and cache. Old hardware doesn't have or has few instrction support for byte computation. And quantization has overhead (quantize and dequantize), so it is not rare to get worse performance on old devices.
Performance improvement depends on your model and hardware. Quantization performance gain comes in 2 part: instruction and cache. Old hardware doesn't have or has few instruction support for byte computation. And quantization has overhead (quantize and dequantize), so it is not rare to get worse performance on old devices.
x86-64 with VNNI, GPU with Tensor Core int8 support and ARM with dot-product instructions can get better performance in general.