saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-30 20:18:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

nvidia awq only use QuantFormat.QDQ quant format (#22429)

Browse source 
nvidia awq only use QuantFormat.QDQ quant format
This commit is contained in:
anujj 2024-10-15 09:02:59 +05:30 committed by GitHub
parent 6e5e320088
commit ec7aa63b3a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
onnxruntime/python/tools/quantization/matmul_4bits_quantizer.py
View file

@ -280,7 +280,7 @@ class NVAWQWeightOnlyQuantConfig(WeightOnlyQuantConfig):
super().__init__(
algorithm="nvidia_awq",
quant_format=quant_format,
quant_format=QuantFormat.QDQ,
op_types_to_quantize=None, # Assuming op_types_to_quantize is handled elsewhere
quant_axes=None, # Assuming quant_axes is handled elsewhere
)