pytorch/torch/distributed/pipelining
2024-12-27 22:21:28 +00:00
..
__init__.py [pipelining] Add ZBV schedule (#142084) 2024-12-11 02:00:57 +00:00
_backward.py [pipelining] add type checking to _backward functions (#140019) 2024-11-12 21:42:08 +00:00
_debug.py remove allow-untyped-defs from torch/distributed/pipelining/_debug.py (#143871) 2024-12-27 01:20:26 +00:00
_IR.py [pipelining] Update tutorials and documentation (#143045) 2024-12-12 18:42:17 +00:00
_unflatten.py remove allow-untyped-defs from distributed/pipelining/_unflatten.py (#143915) 2024-12-27 22:21:28 +00:00
_utils.py
microbatch.py [BE]: Apply PERF401 autofixes from ruff (#140980) 2024-11-20 17:52:07 +00:00
README.md
schedules.py [pipelining] Add ZBV schedule (#142084) 2024-12-11 02:00:57 +00:00
stage.py [pipelining] fix backward_one_chunk when the output of the model is a… (#142237) 2024-12-12 20:59:35 +00:00

Pipeline Parallelism for PyTorch

torch.distributed.pipelining is a package for implementing pipeline parallelism on your model.

Our documentation is available here.

pipeline_diagram_web