Feng Tian 762270c51f add c10d dynamic loading mechanism and unit test (#28068) ... Summary: The original behavior of pytorch c10d only supports built-in c10d backends, such as nccl/gloo/mpi. This patch is used to extend the c10d capability to support dynamically loading 3rd party communication libraries which are derived from ProcessGroup base class. related RFC is in: https://github.com/pytorch/pytorch/issues/27955 Through this way, user just need specify a 3rd party c10d backend name when invoking torch.distributed.init_process_group(). The proposed logic will try to load corresponding c10d backend cpp extension automatically. as for how to develop a new 3rd party c10d backend through cpp extension, pls refer to test/cpp_extensions/cpp_c10d_extension.cpp Pull Request resolved: https://github.com/pytorch/pytorch/pull/28068 Differential Revision: D19174838 Pulled By: agolynski fbshipit-source-id: 3409a504a43ce7260e6f9d1207c00e87471fac62		2020-04-02 15:46:51 -07:00
..
caffe2
cpp	Improve C++ API autograd and indexing docs (#35777)	2020-04-02 09:33:11 -07:00
source	add c10d dynamic loading mechanism and unit test (#28068)	2020-04-02 15:46:51 -07:00
.gitignore
libtorch.rst
make.bat
Makefile
requirements.txt	Revert D19320493: Javadoc changes	2020-01-09 14:23:30 -08:00