Feng Tian 762270c51f add c10d dynamic loading mechanism and unit test (#28068) ... Summary: The original behavior of pytorch c10d only supports built-in c10d backends, such as nccl/gloo/mpi. This patch is used to extend the c10d capability to support dynamically loading 3rd party communication libraries which are derived from ProcessGroup base class. related RFC is in: https://github.com/pytorch/pytorch/issues/27955 Through this way, user just need specify a 3rd party c10d backend name when invoking torch.distributed.init_process_group(). The proposed logic will try to load corresponding c10d backend cpp extension automatically. as for how to develop a new 3rd party c10d backend through cpp extension, pls refer to test/cpp_extensions/cpp_c10d_extension.cpp Pull Request resolved: https://github.com/pytorch/pytorch/pull/28068 Differential Revision: D19174838 Pulled By: agolynski fbshipit-source-id: 3409a504a43ce7260e6f9d1207c00e87471fac62		2020-04-02 15:46:51 -07:00
..
rpc	[1.5 Release][RPC Reliability] RRef Idempotency and RPC Retry enablement (#33636)	2020-03-20 20:07:47 -07:00
test_c10d.py	in test_c10d.py, remove skip_if_rocm from tests that pass locally (#35124)	2020-03-23 15:57:41 -07:00
test_c10d_spawn.py
test_data_parallel.py	[RELAND2] Eager autocasting, out-of-place ops only (with MSVC 2017 fix) (#35102)	2020-03-24 09:08:04 -07:00
test_distributed.py	add c10d dynamic loading mechanism and unit test (#28068)	2020-04-02 15:46:51 -07:00
test_nccl.py