Zach Mueller 6ba31a8a94 Enable users to use their own loss functions + deal with prefetching for grad accum (#34198) ... * bookmark * Bookmark * Bookmark * Actually implement * Pass in kwarg explicitly * Adjust for if we do or don't have labels * Bookmark fix for od * bookmark * Fin * closer * Negate accelerate grad accum div * Fixup not training long enough * Add in compute_loss to take full model output * Document * compute_loss -> compute_loss_fn * Add a test * Refactor * Refactor * Uncomment tests * Update tests/trainer/test_trainer.py Co-authored-by: Daniel Han <danielhanchen@gmail.com> --------- Co-authored-by: Daniel Han <danielhanchen@gmail.com>		2024-10-17 17:01:56 -04:00
..
__init__.py
test_data_collator.py	Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)	2024-07-23 15:56:41 +02:00
test_trainer.py	Enable users to use their own loss functions + deal with prefetching for grad accum (#34198)	2024-10-17 17:01:56 -04:00
test_trainer_callback.py	add a callback hook right before the optimizer step (#33444)	2024-09-13 10:43:45 +02:00
test_trainer_distributed.py	CI: update to ROCm 6.0.2 and test MI300 (#30266)	2024-05-13 18:14:36 +02:00
test_trainer_fsdp.py	Default synced_gpus to True when using FullyShardedDataParallel (#33483)	2024-10-10 14:09:04 -04:00
test_trainer_seq2seq.py	Trainer - deprecate tokenizer for processing_class (#32385)	2024-10-02 14:08:46 +01:00
test_trainer_tpu.py
test_trainer_utils.py	Add strategy to store results in evaluation loop (#30267)	2024-04-17 12:42:27 +01:00