Younes Belkada 3f93fd0694 Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP (#31161) ... * fix llama fsdp * fixup * adding FSDP tests for CPU offloading * fixes * fix tests * fix tests * add it for mixtral * propagate the changes on other models * Update src/transformers/models/phi/modeling_phi.py * Delete utils/testing_scripts/fsdp_cpu_offloading.py Remove script - FSDP + CPU offloading it tested in the test suite * Delete utils/testing_scripts/dummy_fsdp_config.yml * Update + add cache_positions docstring --------- Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>		2024-06-26 14:50:08 +01:00
..
test_fsdp.py	Llama et al. / FSDP : Fix breaking change in 4.40 for FSDP (#31161)	2024-06-26 14:50:08 +01:00