Commit graph

7 commits

Author SHA1 Message Date
Aaron Orenstein
99dbc5b0e2 PEP585 update - test (#145176)
See #145101 for details.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/145176
Approved by: https://github.com/bobrenjc93
2025-01-22 04:48:28 +00:00
zeshengzong
e374d6850a [distributed][test] Remove unused variable and fix doc typo (#136943)
Refactor distributed test code:
- Fix TODO: Remove unused variable
- Fix doc typo
- Migrate deprecated method call `load_state_dict` and `save_state_dict`

Pull Request resolved: https://github.com/pytorch/pytorch/pull/136943
Approved by: https://github.com/H-Huang
2024-10-02 08:31:53 +00:00
Chien-Chin Huang
db8d409d08 [DCP][BE] Apply ufmt to DCP and turn on lintrunner for DCP (#115302)
No logic change. Just typing and ufmt.

Differential Revision: [D51914982](https://our.internmc.facebook.com/intern/diff/D51914982/)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/115302
Approved by: https://github.com/XilunWu, https://github.com/wz337, https://github.com/LucasLLC
ghstack dependencies: #115523
2023-12-13 10:32:36 +00:00
Iris
38b687ed4d [PTD][Checkpoint] Add checkpointing support for DTensor submesh (#96802)
DTensor submesh support is added in https://github.com/pytorch/pytorch/pull/95458.

This PR adds support for DTensor submesh by adding an extra check when create local save/load plan.
If the rank is not participating in the mesh, we simply skip creating WriteItem/ReadItem for the local SavePlan/LoadPlan.

Updated the associated test as well.

cc. @wanchaol, @kumpera
Pull Request resolved: https://github.com/pytorch/pytorch/pull/96802
Approved by: https://github.com/wanchaol
2023-03-21 08:17:17 +00:00
PyTorch MergeBot
417e7bc09f Revert "[PTD][Checkpoint] Add checkpointing support for DTensor submesh (#96802)"
This reverts commit cfa6b52e02.

Reverted https://github.com/pytorch/pytorch/pull/96802 on behalf of https://github.com/huydhn due to This breaks distributed test cfa6b52e02. Probably a landrace as PR signal was green
2023-03-17 01:04:43 +00:00
Iris
cfa6b52e02 [PTD][Checkpoint] Add checkpointing support for DTensor submesh (#96802)
DTensor submesh support is added in https://github.com/pytorch/pytorch/pull/95458.

This PR adds support for DTensor submesh by adding an extra check when create local save/load plan.
If the rank is not participating in the mesh, we simply skip creating WriteItem/ReadItem for the local SavePlan/LoadPlan.

Updated the associated test as well.

cc. @wanchaol, @kumpera
Pull Request resolved: https://github.com/pytorch/pytorch/pull/96802
Approved by: https://github.com/wanchaol
2023-03-16 22:16:58 +00:00
Iris
bb347dc3c3 [PTD][DCP] Add 1D DTensor based DCP (#94868)
Add 1D DTensor based DCP along with its test.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/94868
Approved by: https://github.com/wanchaol, https://github.com/fegin
2023-02-16 23:38:04 +00:00