Raushan Turganbay e0646f3dce Chat template: return vectorized output in processors (#34275) ... * update chat template * style * fix tests * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * typehints + docs * fix tests * remove unnecessary warnings * forgot code style :( * allow users to pass backend and num frames * Update docs/source/en/chat_templating.md Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/image_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * Update src/transformers/processing_utils.py Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> * typo fix * style * address comments * align with "pipeline" template * update docs * update docs * unpack for all kwargs? * wrong conflict resolution while rebasing * tmp * update docs * Update docs/source/en/chat_templating.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/chat_templating.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/chat_templating.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Update docs/source/en/chat_templating.md Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> --------- Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>		2025-01-10 11:05:29 +01:00
..
agents	Change is_soundfile_availble to is_soundfile_available (#35030)	2025-01-03 14:37:42 +01:00
benchmark
bettertransformer
deepspeed
extended
fixtures
fsdp	FSDP grad accum fix (#34645)	2024-11-15 22:28:06 +01:00
generation	fix: Qwen2-VL generate with inputs_embeds (#35466)	2025-01-08 16:36:03 +01:00
models	Chat template: return vectorized output in processors (#34275)	2025-01-10 11:05:29 +01:00
optimization
peft_integration	added logic for deleting adapters once loaded (#34650)	2025-01-06 18:36:40 +00:00
pipelines	Pipeline: simple API for assisted generation (#34504)	2025-01-08 17:08:02 +00:00
quantization	Add Gemma2 GGUF support (#34002)	2025-01-03 14:50:07 +01:00
repo_utils	Fix modular edge case + modular sorting order (#35562)	2025-01-09 17:17:52 +01:00
sagemaker
tokenization	tokenizer train from iterator without pre_tokenizers (#35396)	2025-01-09 15:34:43 +01:00
tp	Simplify Tensor Parallel implementation with PyTorch TP (#34184)	2024-11-18 19:51:49 +01:00
trainer	Fix all output_dir in test_trainer.py to use tmp_dir (#35266)	2025-01-08 19:44:39 +01:00
utils	More model refactoring! (#35359)	2025-01-09 11:09:09 +01:00
__init__.py
test_backbone_common.py
test_configuration_common.py	Load sub-configs from composite configs (#34410)	2024-11-05 11:34:01 +01:00
test_feature_extraction_common.py
test_image_processing_common.py	Fix Qwen2VL processor to handle odd number of frames (#35431)	2025-01-08 13:49:00 +01:00
test_image_transforms.py
test_modeling_common.py	Skip torchscript tests if a cache object is in model's outputs (#35596)	2025-01-10 10:46:03 +01:00
test_modeling_flax_common.py	🚨All attention refactor🚨 (#35235)	2024-12-18 16:53:39 +01:00
test_modeling_tf_common.py	🚨All attention refactor🚨 (#35235)	2024-12-18 16:53:39 +01:00
test_pipeline_mixin.py	Add image text to text pipeline (#34170)	2024-10-31 15:48:11 -04:00
test_processing_common.py	VLMs: major clean up 🧼 (#34502)	2025-01-08 10:35:23 +01:00
test_sequence_feature_extraction_common.py
test_tokenization_common.py	[tokenizers] Ensure that add_prefix_space is propagated to backend_tokenizer.pre_tokenizer (#35593)	2025-01-09 17:46:50 +01:00