Younes Belkada 8298e4ec02 [bnb] Fine-tuning HF 8-bit models (#21290) ... * force `memory_efficient_backward=True` * enhancements - trainer support - add new flag * some changes - internal changes in `Trainer` - small refactor * make quality * Fixes - add new testing util - add new test - change test in Trainer * fix CI test * educate users on how to ft 8bit models * more checks * fix `logger` error * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * adapt from review * fix * add comment * use return instead --------- Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>		2023-02-02 16:39:23 +01:00
..
benchmark
deepspeed	[examples/deepspeed] fix renamed api (#21283)	2023-01-24 09:54:33 -08:00
extended	[bnb optim] fixing test (#21030)	2023-01-12 08:52:54 -08:00
fixtures
generation	Generate: decoder-only models can generate with inputs_embeds (#21405)	2023-02-01 21:50:38 +00:00
mixed_int8	[bnb] Fine-tuning HF 8-bit models (#21290)	2023-02-02 16:39:23 +01:00
models	Fix Graphormer test suite (#21419)	2023-02-02 16:29:13 +01:00
onnx	Add Onnx Config for PoolFormer (#20868)	2022-12-23 01:30:57 -05:00
optimization
pipelines	Pipeline testing - using tiny models on Hub (#20426)	2023-01-30 10:39:43 +01:00
repo_utils
sagemaker
tokenization
trainer	Add AWS Neuron torchrun support (#20806)	2023-01-18 11:21:19 -05:00
utils	Add the GeLU activation from pytorch with the tanh approximation (#21345)	2023-02-02 09:33:04 -05:00
__init__.py
test_configuration_common.py
test_feature_extraction_common.py	Add test_image_processing_common.py (#20785)	2023-01-23 13:48:30 +00:00
test_image_processing_common.py	Add test_image_processing_common.py (#20785)	2023-01-23 13:48:30 +00:00
test_image_transforms.py	Move convert_to_rgb to image_transforms module (#20784)	2022-12-15 18:47:04 +00:00
test_modeling_common.py	Add variant to transformers (#21332)	2023-02-01 09:21:52 +01:00
test_modeling_flax_common.py	Generate: save generation config with the models' .save_pretrained() (#21264)	2023-01-23 16:21:44 +00:00
test_modeling_tf_common.py	Generate: fix TF XLA tests on models with max_position_embeddings or max_target_positions (#21389)	2023-01-31 15:49:34 +00:00
test_sequence_feature_extraction_common.py
test_tokenization_common.py