saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/docs/source
History
Yi Wang e593044748 [Gradient Compression] Update a warning in ddp_comm_hooks.rst (#55031) 
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/55031

It turns out that PowerSGD hooks can work on PyTorch native AMP package, but not Apex AMP package, which can somehow mutate gradients during the execution of communication hooks.

{F561544045}
ghstack-source-id: 125268206

Test Plan:
Used native amp backend for the same pytext model and worked:
f261564342
f261561664

Reviewed By: rohan-varma

Differential Revision: D27436484

fbshipit-source-id: 2b63eb683ce373f9da06d4d224ccc5f0a3016c88
2021-04-02 12:07:50 -07:00
..
_static
_templates various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
community Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
notes Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
rpc Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
scripts
__config__.rst
amp.rst [Relanding] Implemented torch.linalg.multi_dot (#52859) 2021-04-01 04:49:05 -07:00
autograd.rst
backends.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
benchmark_utils.rst
bottleneck.rst
checkpoint.rst
complex_numbers.rst various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
conf.py various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
cpp_extension.rst
cpp_index.rst
cuda.rst docs: add reset_peak_memory_stats in cuda.rst (#54668) 2021-03-29 10:05:20 -07:00
cudnn_persistent_rnn.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
cudnn_rnn_determinism.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
data.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
ddp_comm_hooks.rst [Gradient Compression] Update a warning in ddp_comm_hooks.rst (#55031) 2021-04-02 12:07:50 -07:00
distributed.optim.rst
distributed.rst update distributed doc table for alltoall nccl (#54277) 2021-03-19 15:35:10 -07:00
distributions.rst
dlpack.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
docutils.conf
fft.rst
futures.rst
fx.rst [FX][docs] Render inherited methods in fx.Tracer API reference (#53630) 2021-03-09 14:30:41 -08:00
hub.rst
index.rst [special] add torch.special namespace (#52296) 2021-03-04 00:04:36 -08:00
jit.rst Add documentation for torch.jit.Attribute and torch.jit.annotate (#54485) 2021-03-29 14:44:53 -07:00
jit_builtin_functions.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
jit_language_reference.rst
jit_language_reference_v2.rst Adds torch.* API section for TorchScript Lang Ref (#53236) 2021-04-02 03:01:08 -07:00
jit_python_reference.rst
jit_unsupported.rst
linalg.rst [Relanding] Implemented torch.linalg.multi_dot (#52859) 2021-04-01 04:49:05 -07:00
math-quantizer-equation.png
mobile_optimizer.rst
model_zoo.rst
multiprocessing.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
name_inference.rst
named_tensor.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
nn.functional.rst docs: add functional group_norm (#54673) 2021-03-29 10:21:50 -07:00
nn.init.rst
nn.rst docs: separate autosummary for flatten layers (#54663) 2021-03-29 10:23:34 -07:00
onnx.rst [ONNX] Update scripting docs (#54634) (#54868) 2021-03-31 21:14:27 -07:00
optim.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
pipeline.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
profiler.rst
quantization-support.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
quantization.rst [docs][quant] Fix FX Graph Mode Quantization tutorial link (#54715) 2021-03-29 17:25:19 -07:00
random.rst
rpc.rst Add 'remote_parameters' and 'get_module_rref' to RemoteModule docs. (#54645) 2021-03-26 21:41:28 -07:00
sparse.rst
special.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
storage.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
tensor_attributes.rst
tensor_view.rst
tensorboard.rst
tensors.rst Deprecate legacy constructor torch.Tensor() (#54414) 2021-03-29 05:14:47 -07:00
torch.nn.intrinsic.qat.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
torch.nn.intrinsic.quantized.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
torch.nn.intrinsic.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
torch.nn.qat.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
torch.nn.quantized.dynamic.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
torch.nn.quantized.rst
torch.overrides.rst
torch.quantization.rst Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
torch.rst [numpy] Add torch.take_along_dim (#52833) 2021-03-28 05:22:51 -07:00
type_info.rst