transformers/tests
Howard Liberty f16caf44bb
Add FSDP config for CPU RAM efficient loading through accelerate (#30002)
* Add FSDP config for CPU RAM efficient loading

* Style fix

* Update src/transformers/training_args.py

Co-authored-by: Zach Mueller <muellerzr@gmail.com>

* Update src/transformers/training_args.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Add sync_module_states and cpu_ram_efficient_loading validation logic

* Update src/transformers/training_args.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Style

---------

Co-authored-by: Zach Mueller <muellerzr@gmail.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2024-04-22 13:15:28 +01:00
..
benchmark
bettertransformer
deepspeed 🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190) 2024-04-18 12:49:43 -04:00
extended 🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190) 2024-04-18 12:49:43 -04:00
fixtures Implementation of SuperPoint and AutoModelForKeypointDetection (#28966) 2024-03-19 14:43:02 +00:00
fsdp Add FSDP config for CPU RAM efficient loading through accelerate (#30002) 2024-04-22 13:15:28 +01:00
generation Do not remove half seq length in generation tests (#30016) 2024-04-19 17:32:52 +01:00
models Add TF swiftformer (#23342) 2024-04-19 18:31:43 +01:00
optimization
peft_integration
pipelines Fix all torch pipeline failures except one (#30290) 2024-04-18 10:35:43 +02:00
quantization FIX / AWQ: Fix failing exllama test (#30288) 2024-04-17 11:26:35 +02:00
repo_utils
sagemaker
tokenization Remove static pretrained maps from the library's internals (#29112) 2024-03-25 10:33:38 +01:00
tools
trainer Update unwrap from accelerate (#29933) 2024-04-19 18:05:34 +02:00
utils Fix test transposing image with EXIF Orientation tag (#30319) 2024-04-18 17:41:20 +01:00
__init__.py
test_backbone_common.py
test_cache_utils.py
test_configuration_common.py
test_configuration_utils.py
test_feature_extraction_common.py
test_feature_extraction_utils.py
test_image_processing_common.py
test_image_processing_utils.py
test_image_transforms.py
test_modeling_common.py Enable multi-device for some models (#30207) 2024-04-19 09:24:44 +01:00
test_modeling_flax_common.py fix: Replace deprecated assertEquals with assertEqual (#30241) 2024-04-15 09:36:06 +01:00
test_modeling_flax_utils.py
test_modeling_tf_common.py
test_modeling_tf_utils.py Cast bfloat16 to float32 for Numpy conversions (#29755) 2024-03-21 14:04:11 +00:00
test_modeling_utils.py Fix config + attn_implementation in AutoModelForCausalLM.from_pretrained (#30299) 2024-04-19 17:45:53 +01:00
test_pipeline_mixin.py
test_processing_common.py
test_sequence_feature_extraction_common.py
test_tokenization_common.py fix: Replace deprecated assertEquals with assertEqual (#30241) 2024-04-15 09:36:06 +01:00
test_tokenization_utils.py