saymrwulf/transformers
1
0
Fork 0
mirror of https://github.com/saymrwulf/transformers.git synced 2026-05-14 20:58:08 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Remove quantization related config from dequantized model (#34856)

Browse source 
* Remove quantization related config from dequantized model

* Fix whitespace
This commit is contained in:
Konrad Kalita 2024-11-22 10:06:29 +01:00 committed by GitHub
parent 1867be666d
commit d9e6f307e7
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
src/transformers/quantizers/base.py
View file

@ -215,6 +215,9 @@ class HfQuantizer(ABC):
# Delete quantizer and quantization config # Delete quantizer and quantization config
del model.hf_quantizer del model.hf_quantizer
del model.config.quantization_config
del model.config._pre_quantization_dtype
model.is_quantized = False
return model return model