pytorch/test/distributed
Ke Sang 6c061e5145 [DTensor][Shampoo] add _tenso.zero function (#95863)
Summary:
implement zeros function inside DTensor API
- user specify the zeros tensor shape, and the function will create local zero tensor given the placement information

Test Plan:
{F889157756} - unit test for util function for compute_local_tensor_size
- unit test for _tensor.zeros

Reviewed By: wanchaol

Differential Revision: D43630718

Pull Request resolved: https://github.com/pytorch/pytorch/pull/95863
Approved by: https://github.com/wanchaol
2023-03-03 19:36:44 +00:00
..
_composable [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
_shard Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
_spmd Switch DTensor to use funcol::all_reduce. (#95804) 2023-03-02 17:55:01 +00:00
_tensor [DTensor][Shampoo] add _tenso.zero function (#95863) 2023-03-03 19:36:44 +00:00
_tools add number of cuda retries into tracker (#92557) 2023-01-25 14:44:34 +00:00
algorithms Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
bin
checkpoint [DCP] Update DCP to use the updated FSDP optim state_dict APIs (#95303) 2023-02-23 03:55:02 +00:00
elastic Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
fsdp Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
launcher Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
nn/jit
optim Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
pipeline/sync Run tests in USE_PYTEST_LIST through run_tests (#95659) 2023-02-28 22:09:01 +00:00
rpc [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
tensor/parallel [PT-D][Sequence Parallelism] Enable DTensor based Naive sequence parallelism (#94369) 2023-02-16 21:21:00 +00:00
argparse_util_test.py
test_c10d_common.py Add support for custom backend (#95072) 2023-03-02 21:41:49 +00:00
test_c10d_error_logger.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_c10d_gloo.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_c10d_nccl.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_c10d_object_collectives.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_c10d_pypg.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_c10d_spawn.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_c10d_spawn_gloo.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_c10d_spawn_nccl.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_c10d_spawn_ucc.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_data_parallel.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_distributed_spawn.py correct use of torch.backends.cudnn.flags() (#93182) 2023-01-28 06:50:06 +00:00
test_dynamo_distributed.py Make DDPOptimizer work with torch._dynamo.explain() (#94749) 2023-02-14 01:33:47 +00:00
test_functional_api.py [PTD] Introduce tracing friendly collectives. (#93990) 2023-02-16 15:35:01 +00:00
test_inductor_collectives.py Support Inductor collectives with wait or collective outside graph (#95893) 2023-03-03 09:00:48 +00:00
test_launcher.py [BE] Prefer dash over underscore in command-line options (#94505) 2023-02-09 20:16:49 +00:00
test_multi_threaded_pg.py [MTPG] Improve all_reduce and handle bwd thread support (#95524) 2023-03-03 18:53:36 +00:00
test_nccl.py Fix "sandcastle_skip_if decorator name is confusing" (#95649) 2023-03-03 09:29:40 +00:00
test_pg_wrapper.py [BE] [3/3] Rewrite super() calls in test (#94592) 2023-02-12 22:20:53 +00:00
test_store.py [BE] Remove dependency on six and future (#94709) 2023-02-14 09:14:14 +00:00