mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-13 18:08:13 +00:00
### Description Introduce how to use matmul_4bits_quantizer to do weight only quantization. ### Motivation and Context Add 4bit quantizer to onnx runtime doc |
||
|---|---|---|
| .. | ||
| api | ||
| build | ||
| ecosystem | ||
| execution-providers | ||
| extensions | ||
| genai | ||
| get-started | ||
| install | ||
| performance | ||
| reference | ||
| tutorials | ||
| index.md | ||
| redirect.json | ||