Adam Louly ee74fb6908 Introducing ORTPipelineModule - DeepSpeed Parallel Pipeline Support. (#20287) ... ### Description Introducing a new class ORTPipelineModule to handle wrapping layers in DeepSpeed pipeline parallel. ### Motivation and Context To support pipeline parallelism on ORTModule. This PR will include an initial support of deepspeed Pipeline parallelism. - [x] Support Pipeline parallel where layers are nn Modules in Sequential. - [ ] Support LayerSpec and TiedLayerSpec - [ ] Enable partitioning to accept List - [ ] Full-GPU Graph Consolidation - [ ] Subgraph Merging for Inference		2024-04-18 11:30:15 -07:00
..
hierarchical_ortmodule	Bump ruff linter to 0.2.1 (#19471)	2024-02-08 16:08:27 -08:00
json_config
pipe	Introducing ORTPipelineModule - DeepSpeed Parallel Pipeline Support. (#20287)	2024-04-18 11:30:15 -07:00
__init__.py