saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/test/distributed
History
Pritam Damania b420ded66f ShardedTensor framework for ChunkedShardingSpec (#58517) 
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/58517

Building upon the sharding specifications, this PR introduces the
intial skeleton of ShardedTensor and allows building a ShardedTensor by
specifying ChunkedShardingSpec.

In follow up PRs, I'll add further support for GenericShardingSpec.
ghstack-source-id: 129917841

Test Plan:
1) unit tests.
2) waitforbuildbot

Reviewed By: SciPioneer

Differential Revision: D28526012

fbshipit-source-id: 8e62847b58957d284e40f57a644302c171289138
2021-05-26 13:24:23 -07:00
..
_sharded_tensor ShardedTensor framework for ChunkedShardingSpec (#58517) 2021-05-26 13:24:23 -07:00
_sharding_spec ShardedTensor framework for ChunkedShardingSpec (#58517) 2021-05-26 13:24:23 -07:00
algorithms/ddp_comm_hooks
bin Pytorch resolve bug around incorrect rdzv handler resolution (#56386) 2021-04-19 23:50:28 -07:00
elastic [torch/elastic] Revise distributed run script (#58159) 2021-05-12 16:53:31 -07:00
launcher [tsm] add support for jetter to Role (base_image) for mast launches (#58252) 2021-05-14 17:39:18 -07:00
nn/jit
optim Add lint for unqualified type: ignore (#56290) 2021-04-21 08:07:23 -07:00
pipeline/sync combine consecutive layes on the same device (#55973) 2021-05-11 08:04:08 -07:00
rpc Skip RPC's CPU-only tests on CircleCI GPU jobs (#55778) 2021-04-15 11:20:44 -07:00
argparse_util_test.py [19/n][torch/elastic][upstream] Replace pytorch.distributed.launch with torchelastic launcher (#56214) 2021-04-16 13:38:23 -07:00
test_c10d_common.py [c10d] Introduce ProcessGroupWrapper (#58224) 2021-05-24 20:09:51 -07:00
test_c10d_gloo.py [c10d] Use pg wrapper in detailed debug mode (#58281) 2021-05-25 09:55:52 -07:00
test_c10d_nccl.py [c10d] Use pg wrapper in detailed debug mode (#58281) 2021-05-25 09:55:52 -07:00
test_c10d_spawn.py Split test_c10d.py to test_c10d_common.py, test_c10d_gloo.py, test_c10d_nccl.py (#56598) 2021-04-21 22:10:41 -07:00
test_c10d_spawn_gloo.py Add Python-3.9 CI testing (#50992) 2021-05-10 10:51:39 -07:00
test_c10d_spawn_nccl.py Add Python-3.9 CI testing (#50992) 2021-05-10 10:51:39 -07:00
test_data_parallel.py
test_distributed_fork.py [RFC]fix test_ddp_logging_data_cpu with tsan (#54465) 2021-04-13 11:20:43 -07:00
test_distributed_spawn.py
test_jit_c10d.py Fix misleading messages in test_jit_c10d (#57256) 2021-04-29 09:17:41 -07:00
test_launcher.py Pytorch resolve bug around incorrect rdzv handler resolution (#56386) 2021-04-19 23:50:28 -07:00
test_nccl.py