saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/docs/source/distributed.optim.rst

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

12 lines
307 B
ReStructuredText
Raw Normal View History

[Reland] Update and expose ZeroRedundancyOptimizer docs (#53112) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/53112 Test Plan: Imported from OSS Reviewed By: blefaudeux Differential Revision: D26752289 Pulled By: mrshenli fbshipit-source-id: 897257417b530e6e18788cb40c44e5cb7ac688d5
2021-03-02 22:08:07 +00:00
.. role:: hidden
:class: hidden-section
Distributed Optimizers
======================
[distributed][docs] Delete distributed optimimzer section from RPC and add reference to namespace docs page (#68068) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/68068 cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang Test Plan: Imported from OSS Reviewed By: pritamdamania87 Differential Revision: D32286554 Pulled By: jamesr66a fbshipit-source-id: a43fe1f0cfa74721f467b128f2e878bd02f32546
2021-11-09 22:57:52 +00:00
.. warning ::
Distributed optimizer is not currently supported when using CUDA tensors
[distributed] Render `torch.distributed.optim` members (#67885) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/67885 cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang Test Plan: Imported from OSS Reviewed By: mrshenli Differential Revision: D32191952 Pulled By: jamesr66a fbshipit-source-id: a9ed52da8e89b3491eab2e691f5571338f83e8e3
2021-11-09 00:18:21 +00:00
[distributed][docs] Delete distributed optimimzer section from RPC and add reference to namespace docs page (#68068) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/68068 cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang Test Plan: Imported from OSS Reviewed By: pritamdamania87 Differential Revision: D32286554 Pulled By: jamesr66a fbshipit-source-id: a43fe1f0cfa74721f467b128f2e878bd02f32546
2021-11-09 22:57:52 +00:00
.. automodule:: torch.distributed.optim
:members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer
Reference in a new issue Copy permalink