saymrwulf/pytorch
1
0
Fork 0
mirror of https://github.com/saymrwulf/pytorch.git synced 2026-05-14 20:57:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
pytorch/docs/source
History
Yi Wang 4b00bce156 [Gradient Compression] Introduce fp16_compress_wrapper in ddp_comm_hooks.rst (#54052) 
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/54052

Introduce `fp16_compress_wrapper`, which can give some speedup on top of some gradient compression algorithms like PowerSGD.

ghstack-source-id: 124001805

Test Plan: {F509205173}

Reviewed By: iseessel

Differential Revision: D27076064

fbshipit-source-id: 4845a14854cafe2112c0caefc1e2532efe9d3ed8
2021-03-16 15:40:10 -07:00
..
_static
_templates various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
community
notes Fix inport -> import typo in documentation (#53589) 2021-03-08 23:56:42 -08:00
rpc Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
scripts
__config__.rst
amp.rst
autograd.rst
backends.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
benchmark_utils.rst
bottleneck.rst
checkpoint.rst
complex_numbers.rst various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
conf.py various doc building cleanups (#53851) 2021-03-16 15:01:59 -07:00
cpp_extension.rst
cpp_index.rst
cuda.rst
cudnn_persistent_rnn.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
cudnn_rnn_determinism.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
data.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
ddp_comm_hooks.rst [Gradient Compression] Introduce fp16_compress_wrapper in ddp_comm_hooks.rst (#54052) 2021-03-16 15:40:10 -07:00
distributed.optim.rst [Reland] Update and expose ZeroRedundancyOptimizer docs (#53112) 2021-03-02 14:16:12 -08:00
distributed.rst [doc] reorg dist init and non-init functions (#52976) 2021-03-12 08:48:18 -08:00
distributions.rst Add sample validation for LKJCholesky.log_prob (#52763) 2021-02-25 16:12:29 -08:00
dlpack.rst
docutils.conf
fft.rst
futures.rst
fx.rst [FX][docs] Render inherited methods in fx.Tracer API reference (#53630) 2021-03-09 14:30:41 -08:00
hub.rst
index.rst [special] add torch.special namespace (#52296) 2021-03-04 00:04:36 -08:00
jit.rst [docs] Add starter content for new TorchScript language reference (#53837) 2021-03-11 18:18:27 -08:00
jit_builtin_functions.rst
jit_language_reference.rst
jit_language_reference_v2.rst [docs] Add starter content for new TorchScript language reference (#53837) 2021-03-11 18:18:27 -08:00
jit_python_reference.rst
jit_unsupported.rst
linalg.rst Implements torch.linalg.lstsq (#49093) 2021-03-12 13:25:55 -08:00
math-quantizer-equation.png
mobile_optimizer.rst
model_zoo.rst
multiprocessing.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
name_inference.rst
named_tensor.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
nn.functional.rst Huber loss (#50553) 2021-03-02 17:30:45 -08:00
nn.init.rst
nn.rst Parametrization Functionality (#33344) 2021-03-04 12:45:27 -08:00
onnx.rst [ONNX] Update ONNX documentation (#51362) (#53313) 2021-03-12 02:49:38 -08:00
optim.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
pipeline.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
profiler.rst Update docs for torch.profiler.tensorboard_trace_handler (#51636) 2021-02-04 13:32:59 -08:00
quantization-support.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
quantization.rst
random.rst
rpc.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
sparse.rst [wip] doc_fix (#51825) 2021-02-06 11:36:36 -08:00
special.rst [special] add torch.special namespace (#52296) 2021-03-04 00:04:36 -08:00
storage.rst [docs] Add docs for storage and tensors for quantized Tensor (#51817) 2021-02-09 13:20:56 -08:00
tensor_attributes.rst Fix the repeated entry in the Tensor Attributes doc (#52995) 2021-03-01 16:42:32 -08:00
tensor_view.rst
tensorboard.rst
tensors.rst Implements cpu_kernel_multiple_outputs and torch.frexp (#51097) 2021-03-15 10:44:32 -07:00
torch.nn.intrinsic.qat.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
torch.nn.intrinsic.quantized.rst
torch.nn.intrinsic.rst [quantization] Add some support for 3d operations (#50003) 2021-03-10 16:40:35 -08:00
torch.nn.qat.rst
torch.nn.quantized.dynamic.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
torch.nn.quantized.rst [quant] add docs for embedding/embedding_bag (#51770) 2021-02-05 11:43:15 -08:00
torch.overrides.rst
torch.quantization.rst Forbid trailing whitespace (#53406) 2021-03-05 17:22:55 -08:00
torch.rst Implements cpu_kernel_multiple_outputs and torch.frexp (#51097) 2021-03-15 10:44:32 -07:00
type_info.rst