Adam Louly ee74fb6908 Introducing ORTPipelineModule - DeepSpeed Parallel Pipeline Support. (#20287) ... ### Description Introducing a new class ORTPipelineModule to handle wrapping layers in DeepSpeed pipeline parallel. ### Motivation and Context To support pipeline parallelism on ORTModule. This PR will include an initial support of deepspeed Pipeline parallelism. - [x] Support Pipeline parallel where layers are nn Modules in Sequential. - [ ] Support LayerSpec and TiedLayerSpec - [ ] Enable partitioning to accept List - [ ] Full-GPU Graph Consolidation - [ ] Subgraph Merging for Inference		2024-04-18 11:30:15 -07:00
..
orttraining	Introducing ORTPipelineModule - DeepSpeed Parallel Pipeline Support. (#20287)	2024-04-18 11:30:15 -07:00
tools	Bump ruff to 0.3.2 and black to 24 (#19878)	2024-03-13 10:00:32 -07:00