Howard Huang eb954ef3f2 [pipelining] allow multiple backward grads (#140981) ... fixes https://github.com/pytorch/pytorch/issues/139404. The input grads get saved in a new `self.bwd_cache` container and get popped off after they are used in `backward_one_chunk` `python test/distributed/pipelining/test_schedule_multiproc.py -k test_pipeline_schedule_runtime_custom_sched` Pull Request resolved: https://github.com/pytorch/pytorch/pull/140981 Approved by: https://github.com/wconstab		2024-11-23 00:35:08 +00:00
..
artifacts	[Pipelining] Support separate dI / dW and V-schedules (#131762)	2024-10-31 22:49:45 +00:00
__init__.py
model_registry.py
schedule_registry.py	[pipelining] allow multiple backward grads (#140981)	2024-11-23 00:35:08 +00:00
test_backward.py
test_microbatch.py
test_pipe.py
test_schedule.py	[Pipelining] Update schedules to use I, B actions. (#138886)	2024-11-01 03:54:06 +00:00
test_schedule_multiproc.py	[pipelining] allow multiple backward grads (#140981)	2024-11-23 00:35:08 +00:00
test_stage.py
test_transformer.py
test_unflatten.py	Move pippy to training IR (#139233)	2024-11-04 23:07:14 +00:00