transformers/tests
bastrob 464d986b6c
Add missing Flaubert tokenizer tests (#30492)
* add flaubert tokenization test, enrich inheritance in FlaubertTokenizer.

* fix quality code ci

* ensure parameter consistency

* fix ci

* fix copyright year and flatten vocab list.

* fix style
2024-06-05 13:52:16 +02:00
..
agents Add streaming, various fixes (#30838) 2024-05-31 14:16:23 +02:00
benchmark
bettertransformer
deepspeed
extended
fixtures
fsdp
generation Pass device in Logits Processor's init (#29804) 2024-06-04 10:19:19 +05:00
models Add missing Flaubert tokenizer tests (#30492) 2024-06-05 13:52:16 +02:00
optimization fix get_scheduler when name is warmup_stable_decay (#31128) 2024-05-30 15:25:43 +01:00
peft_integration
pipelines Fix pipeline tests - torch imports (#31227) 2024-06-04 12:30:23 +01:00
quantization Add Qwen2 GGUF loading support (#31175) 2024-06-03 14:55:10 +01:00
repo_utils
sagemaker update ruff version (#30932) 2024-05-22 06:40:15 +02:00
tokenization update ruff version (#30932) 2024-05-22 06:40:15 +02:00
trainer Add on_optimizer_step to callback options (#31095) 2024-05-29 16:20:59 +02:00
utils Use HF_HUB_OFFLINE + fix has_file in offline mode (#31016) 2024-05-29 11:55:43 +01:00
__init__.py
test_backbone_common.py
test_cache_utils.py
test_configuration_common.py
test_configuration_utils.py Use HF_HUB_OFFLINE + fix has_file in offline mode (#31016) 2024-05-29 11:55:43 +01:00
test_feature_extraction_common.py
test_feature_extraction_utils.py
test_image_processing_common.py
test_image_processing_utils.py
test_image_transforms.py fix: center_crop occasionally outputs off-by-one dimension matrix (#30934) 2024-05-21 13:56:52 +01:00
test_modeling_common.py [tests] make test_model_parallelism device-agnostic (#30844) 2024-05-24 11:51:51 +01:00
test_modeling_flax_common.py
test_modeling_flax_utils.py
test_modeling_tf_common.py
test_modeling_tf_utils.py
test_modeling_utils.py fix from_pretrained in offline mode when model is preloaded in cache (#31010) 2024-05-28 11:56:05 +02:00
test_pipeline_mixin.py
test_processing_common.py
test_sequence_feature_extraction_common.py
test_tokenization_common.py Add split special tokens (#30772) 2024-05-24 08:38:58 -07:00
test_tokenization_utils.py Token healing (#30081) 2024-06-03 10:53:15 +02:00