pytorch/torch/distributed/_composable
Chien-Chin Huang b1fb591272 [replicate] Simplify replicate() init logic and remove unnecessary variables in _ReplicateState (#113679)
Many variables _ReplicateState are created because replicate() was lazy initialized. This PR removes these variables and simplifes the logic.y

Differential Revision: [D51317874](https://our.internmc.facebook.com/intern/diff/D51317874/)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/113679
Approved by: https://github.com/awgu
2023-11-28 00:55:36 +00:00
..
__init__.py
checkpoint_activation.py
contract.py
fully_shard.py
replicate.py [replicate] Simplify replicate() init logic and remove unnecessary variables in _ReplicateState (#113679) 2023-11-28 00:55:36 +00:00