mirror of
https://github.com/saymrwulf/pytorch.git
synced 2026-05-14 20:57:59 +00:00
45583a5df9
**Overview** This PR moves `torch/distributed/_composable/fsdp` to `torch/distributed/fsdp/_fully_shard` and makes public APIs available from `torch.distributed.fsdp`, e.g.: ``` from torch.distributed.fsdp import fully_shard ``` This is targeting 2.6 release. I rewrote some of the documentation with (hopefully) improved phrasing. **Follow-Ups** - [x] Add some explanation in the docs about FSDP1 vs. FSDP2 - [ ] Move unit tests from `test/distributed/_composable/fsdp` to `test/distributed/fsdp/fully_shard/` Pull Request resolved: https://github.com/pytorch/pytorch/pull/141868 Approved by: https://github.com/kwen2501, https://github.com/wconstab, https://github.com/weifengpy Co-authored-by: Svetlana Karslioglu <svekars@meta.com> |
||
|---|---|---|
| .. | ||
| e2e | ||
| fsdp | ||
| test_checkpoint.py | ||
| test_compatibility.py | ||
| test_dedup_tensors.py | ||
| test_dtensor_checkpoint.py | ||
| test_dtensor_resharding.py | ||
| test_file_system_checkpoint.py | ||
| test_file_system_checkpoint_cpu.py | ||
| test_format_utils.py | ||
| test_fsdp_model_state.py | ||
| test_fsdp_optim_state.py | ||
| test_fsdp_tp_checkpoint_conversion.py | ||
| test_fsspec.py | ||
| test_hsdp_checkpoint.py | ||
| test_nested_dict.py | ||
| test_planner.py | ||
| test_save_load_api.py | ||
| test_state_dict.py | ||
| test_state_dict_utils.py | ||
| test_tp_checkpoint.py | ||
| test_traverse.py | ||
| test_utils.py | ||