mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-14 18:12:05 +00:00
### Description Introduce how to use matmul_4bits_quantizer to do weight only quantization. ### Motivation and Context Add 4bit quantizer to onnx runtime doc |
||
|---|---|---|
| .. | ||
| model-optimizations | ||
| tune-performance | ||
| device-tensor.md | ||
| index.md | ||
| mobile-performance-tuning.md | ||
| olive.md | ||
| transformers-optimization.md | ||