saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/performance/model-optimizations
History
Jing Fang 6265c3acf2
Add 4bit quantizer to onnx runtime doc (#21835) 
### Description
Introduce how to use matmul_4bits_quantizer to do weight only
quantization.

### Motivation and Context
Add 4bit quantizer to onnx runtime doc
2024-08-26 18:12:13 -07:00
..
float16.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
graph-optimizations.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
index.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
ort-format-model-runtime-optimization.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
ort-format-models.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
quantization.md Add 4bit quantizer to onnx runtime doc (#21835) 2024-08-26 18:12:13 -07:00