pytorch/docs/source
Codrin Popa 5b767d404e Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290)
Summary:
Improved roundup_power2_divisions knob so it allows better control of rouding in the PyTorch CUDA Caching Allocator.

This new version allows setting the number of divisions per power of two interval starting from 1MB and ending at 64GB and above. An example use case is when rouding is desirable for small allocations but there are also very large allocations which are persistent, thus would not benefit from rounding and take up extra space.

Test Plan: Tested locally

Differential Revision: D40103909

Pull Request resolved: https://github.com/pytorch/pytorch/pull/87290
Approved by: https://github.com/zdevito
2022-11-04 19:31:16 +00:00
..
_static [maskedtensor] add docs (#84887) 2022-10-19 20:44:34 +00:00
_templates
community Add General Project Policies (#87385) 2022-10-20 21:02:09 +00:00
elastic Add watchdog to TorchElastic agent and trainers (#84081) 2022-09-07 00:17:20 +00:00
notes Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290) 2022-11-04 19:31:16 +00:00
rpc
scripts [ONNX] Update ONNX documentation to include unsupported operators (#84496) 2022-09-16 23:48:37 +00:00
amp.rst Remove deprecated torch.matrix_rank (#70981) 2022-09-22 17:40:46 +00:00
autograd.rst Change torch.autograd.graph.disable_saved_tensors_hooks to be public API (#85994) 2022-10-03 16:25:01 +00:00
backends.rst Add mem efficient backend flag (#87946) 2022-10-28 15:51:10 +00:00
benchmark_utils.rst
bottleneck.rst add itt unit test and docstrings (#84848) 2022-09-28 01:39:58 +00:00
checkpoint.rst
complex_numbers.rst
conf.py Unify SymIntNode and SymFloatNode into SymNode (#87817) 2022-10-27 20:56:02 +00:00
config_mod.rst
cpp_extension.rst
cpp_index.rst
cuda._sanitizer.rst Fix typos under docs directory (#88033) 2022-10-31 19:31:56 +00:00
cuda.rst (Re-open) Adds cudaMallocAsync as an alternative backend for the CUDA allocator (#82682) 2022-10-12 03:44:21 +00:00
cudnn_persistent_rnn.rst
cudnn_rnn_determinism.rst
data.rst Fix typos under docs directory (#88033) 2022-10-31 19:31:56 +00:00
ddp_comm_hooks.rst
deploy.rst Delete torch::deploy from pytorch core (#85953) 2022-10-06 07:20:16 +00:00
distributed.algorithms.join.rst
distributed.elastic.rst
distributed.optim.rst
distributed.rst [docs] batch_isend_irecv and P2POp of torch.distributed (#86438) 2022-10-25 00:11:50 +00:00
distributions.rst
dlpack.rst
docutils.conf
fft.rst
fsdp.rst [FSDP()][3/N] Refactor public APIs (#87917) 2022-10-31 16:45:21 +00:00
futures.rst
fx.rst prepare removal of deprecated functionality in torch.testing (#87969) 2022-11-02 14:04:48 +00:00
hub.rst
index.rst Set up new module torch.signal.windows (#85599) 2022-10-14 11:33:32 +00:00
jit.rst
jit_builtin_functions.rst
jit_language_reference.rst (Re-open) Adds cudaMallocAsync as an alternative backend for the CUDA allocator (#82682) 2022-10-12 03:44:21 +00:00
jit_language_reference_v2.rst
jit_python_reference.rst
jit_unsupported.rst (Re-open) Adds cudaMallocAsync as an alternative backend for the CUDA allocator (#82682) 2022-10-12 03:44:21 +00:00
jit_utils.rst
library.rst
linalg.rst
masked.rst Fix links to tutorial in torch masked docs (#88129) 2022-10-31 21:31:54 +00:00
math-quantizer-equation.png
mobile_optimizer.rst [Vulkan] Add Vulkan Rewrite to Transfer Inputs and Outputs to Vulkan and CPU Backends Respectively (#87432) 2022-10-31 14:18:45 +00:00
model_zoo.rst
monitor.rst
multiprocessing.rst
name_inference.rst
named_tensor.rst
nested.rst Add support for neg to NestedTensor (#88131) 2022-11-03 15:15:57 +00:00
nn.functional.rst
nn.init.rst
nn.rst
onnx.rst [ONNX] Update user documentation (#85819) 2022-09-30 19:35:34 +00:00
onnx_supported_aten_ops.rst [ONNX] Update ONNX documentation to include unsupported operators (#84496) 2022-09-16 23:48:37 +00:00
optim.rst [doc] LR scheduler example fix (#86629) 2022-10-11 21:41:50 +00:00
package.rst
pipeline.rst
profiler.rst Fix ITT unit-tests if PyTorch is compiled with USE_ITT=OFF (#86199) 2022-10-04 21:57:05 +00:00
quantization-accuracy-debugging.rst Fix typo under docs directory (#87583) 2022-10-24 23:52:44 +00:00
quantization-backend-configuration.rst
quantization-support.rst Fix typos under docs directory (#88033) 2022-10-31 19:31:56 +00:00
quantization.rst Fix typos under docs directory (#88033) 2022-10-31 19:31:56 +00:00
random.rst
rpc.rst Fix typo under docs directory and RELEASE.md (#85896) 2022-09-29 21:41:59 +00:00
signal.rst Reimplement Kaiser window (#87330) 2022-10-27 21:01:01 +00:00
sparse.rst Fix typo under docs directory (#87583) 2022-10-24 23:52:44 +00:00
special.rst [primTorch] special: j0, j1, spherical_j0 (#86049) 2022-10-04 18:21:46 +00:00
storage.rst
tensor_attributes.rst Chore: Add 'mps' to the docs of tensor_attributes (#86585) 2022-10-14 19:59:33 +00:00
tensor_view.rst
tensorboard.rst
tensors.rst Remove deprecated torch.lstsq (#70980) 2022-09-23 00:16:55 +00:00
testing.rst
torch.ao.ns._numeric_suite.rst
torch.ao.ns._numeric_suite_fx.rst
torch.overrides.rst
torch.rst [primTorch] Add a ref for narrow_copy (#86748) 2022-10-17 10:16:05 +00:00
type_info.rst