pytorch/docs/source/notes
Codrin Popa 5b767d404e Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290)
Summary:
Improved roundup_power2_divisions knob so it allows better control of rouding in the PyTorch CUDA Caching Allocator.

This new version allows setting the number of divisions per power of two interval starting from 1MB and ending at 64GB and above. An example use case is when rouding is desirable for small allocations but there are also very large allocations which are persistent, thus would not benefit from rounding and take up extra space.

Test Plan: Tested locally

Differential Revision: D40103909

Pull Request resolved: https://github.com/pytorch/pytorch/pull/87290
Approved by: https://github.com/zdevito
2022-11-04 19:31:16 +00:00
..
amp_examples.rst [AMP] Use generic autocast in example, specify dtype (#79579) 2022-06-17 21:32:51 +00:00
autograd.rst Fix typo under docs directory and RELEASE.md (#85896) 2022-09-29 21:41:59 +00:00
broadcasting.rst Fixes docs (#51439) 2021-01-31 22:00:26 -08:00
cpu_threading_runtimes.svg
cpu_threading_torchscript_inference.rst
cpu_threading_torchscript_inference.svg Lint trailing newlines (#54737) 2021-03-30 13:09:52 -07:00
cuda.rst Modified roundup_power2_divisions to specify the number of divisions for each power of two interval (#87290) 2022-11-04 19:31:16 +00:00
ddp.rst [Docs][BE] DDP doc fix (#71363) 2022-01-18 22:24:51 +00:00
extending.rst [docs] Fix ScalarTensor __repr__ in Extending PyTorch example (#86330) 2022-10-17 20:01:10 +00:00
faq.rst Update faq.rst so OOM section mentions checkpoint (#62709) 2021-08-05 07:40:08 -07:00
gradcheck.rst Add first draft of gradcheck note (#55966) 2021-04-27 14:33:42 -07:00
hip.rst Introduce TORCH_DISABLE_GPU_ASSERTS (#84190) 2022-11-04 04:43:05 +00:00
large_scale_deployments.rst
modules.rst Fix typo under docs directory (#87583) 2022-10-24 23:52:44 +00:00
mps.rst update mps note with more details (#78669) 2022-06-02 20:53:19 +00:00
multiprocessing.rst
numerical_accuracy.rst Fix typo under docs directory (#87583) 2022-10-24 23:52:44 +00:00
randomness.rst Improve reproducibility docs for RNG (#78849) 2022-06-06 14:53:59 +00:00
serialization.rst [DOC] Missing line in serialization notes (#79454) 2022-06-17 18:26:47 +00:00
windows.rst Remove remaining THC code (#69039) 2021-12-08 12:18:08 -08:00