pytorch/test/distributed/checkpoint
Chien-Chin Huang d947534782 [DCP] Enable filesystem/fsspec auto detection (#118888)
This API enables the ability to automatically detect whether to use filesystem or fsspec based on the checkpoint_id.

Differential Revision: [D53318043](https://our.internmc.facebook.com/intern/diff/D53318043/)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/118888
Approved by: https://github.com/wz337, https://github.com/LucasLLC
2024-02-08 16:38:04 +00:00
..
e2e Enables load balancing duplicates in DCP (#116469) 2024-01-26 22:34:14 +00:00
test_checkpoint.py [DCP] Enable filesystem/fsspec auto detection (#118888) 2024-02-08 16:38:04 +00:00
test_compatibility.py [DCP][BC] Remove the dependency on _shard.TensorProperties (#116248) 2024-01-25 17:24:16 +00:00
test_dedup_tensors.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_dtensor_checkpoint.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_dtensor_resharding.py [DTensor] Remove assert to allow tensor sharding dimension < Shard(x).ndim (#115114) 2023-12-07 21:57:30 +00:00
test_file_system_checkpoint.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_file_system_checkpoint_cpu.py Enables load balancing duplicates in DCP (#116469) 2024-01-26 22:34:14 +00:00
test_fsdp_model_state.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_fsdp_optim_state.py [DCP] Add test for planner option for load_sharded_optimizer_state_dict (#112891) 2023-11-03 22:37:49 +00:00
test_fsdp_tp_checkpoint_conversion.py [DCP][BE] Move DCP._state_dict_utils out from DCP (#115523) 2023-12-13 08:59:48 +00:00
test_fsspec.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_hsdp_checkpoint.py
test_nested_dict.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_planner.py Enables load balancing duplicates in DCP (#116469) 2024-01-26 22:34:14 +00:00
test_save_load_api.py [DCP] Enable filesystem/fsspec auto detection (#118888) 2024-02-08 16:38:04 +00:00
test_state_dict.py [DCP] Removes Checkpoint Wrapped Prefix from state dict fqns (#118119) 2024-01-29 18:18:52 +00:00
test_state_dict_utils.py [DCP][BE] Move DCP._state_dict_utils out from DCP (#115523) 2023-12-13 08:59:48 +00:00
test_torch_save_to_dcp.py [DCP] Enable filesystem/fsspec auto detection (#118888) 2024-02-08 16:38:04 +00:00
test_tp_checkpoint.py [DCP] Adds support for meta tensor loading for DCP.load_state_dict() (#113319) 2024-01-17 00:23:29 +00:00
test_traverse.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00
test_utils.py [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302) 2023-12-13 10:32:36 +00:00