pytorch/docs/source/distributed.algorithms.join.rst
chronos_secgrp_pytorch_oss_ci_oncall fd62ee1fff 2021-08-08 nightly release (30214aef2d)
2021-08-08 00:04:31 -07:00

20 lines
725 B
ReStructuredText

.. role:: hidden
:class: hidden-section
Generic Join Context Manager
============================
The generic join context manager facilitates distributed training on uneven
inputs. This page outlines the API of the relevant classes: :class:`Join`,
:class:`Joinable`, and :class:`JoinHook`. For a tutorial, see
`Distributed Training with Uneven Inputs Using the Join Context Manager`_.
.. autoclass:: torch.distributed.algorithms.Join
:members:
.. autoclass:: torch.distributed.algorithms.Joinable
:members:
.. autoclass:: torch.distributed.algorithms.JoinHook
:members:
.. _Distributed Training with Uneven Inputs Using the Join Context Manager: https://pytorch.org/tutorials/advanced/generic_join.html