transformers/docs/source/en
wejoncy 4e27a4009d
FEAT : Adding VPTQ quantization method to HFQuantizer (#34770)
* init vptq

* add integration

* add vptq support

fix readme

* add tests && format

* format

* address comments

* format

* format

* address comments

* format

* address comments

* remove debug code

* Revert "remove debug code"

This reverts commit ed3b3eaaba82caf58cb3aa6e865d98e49650cf66.

* fix test

---------

Co-authored-by: Yang Wang <wyatuestc@gmail.com>
2024-12-20 09:45:53 +01:00
..
internal
main_classes
model_doc
quantization
tasks
_config.py
_redirects.yml
_toctree.yml
accelerate.md
add_new_model.md
add_new_pipeline.md
agents.md
agents_advanced.md
attention.md
autoclass_tutorial.md
benchmarks.md
bertology.md
big_models.md
chat_templating.md
community.md
contributing.md
conversations.md
create_a_model.md
custom_models.md
debugging.md
deepspeed.md
fast_tokenizers.md
fsdp.md
generation_strategies.md
gguf.md
glossary.md
how_to_hack_models.md
hpo_train.md
index.md
installation.md
kv_cache.md
llm_optims.md
llm_tutorial.md
llm_tutorial_optimization.md
model_memory_anatomy.md
model_sharing.md
model_summary.md
modular_transformers.md
multilingual.md
notebooks.md
pad_truncation.md
peft.md
perf_hardware.md
perf_infer_cpu.md
perf_infer_gpu_multi.md
perf_infer_gpu_one.md
perf_torch_compile.md
perf_train_cpu.md
perf_train_cpu_many.md
perf_train_gpu_many.md
perf_train_gpu_one.md
perf_train_special.md
perf_train_tpu_tf.md
performance.md
perplexity.md
philosophy.md
pipeline_tutorial.md
pipeline_webserver.md
pr_checks.md
preprocessing.md
quicktour.md
run_scripts.md
sagemaker.md
serialization.md
task_summary.md
tasks_explained.md
testing.md
tf_xla.md
tflite.md
tiktoken.md
tokenizer_summary.md
torchscript.md
trainer.md
training.md
troubleshooting.md