onnxruntime/orttraining
Adam Louly 4ce7bbf6f1
Add LayerSpec Support to ORTPipelineModule (#20410)
### Description
In Deepspeed's Pipeline Parallel Implementation, there is a class used
to instantiate the object after it's moved to the device and assigned in
a stage.

This approach helps reduce peak memory usage. 

In this PR, we're adding support to ORT for wrapping this LayerSpec.
2024-04-23 17:57:08 -07:00
..
orttraining Add LayerSpec Support to ORTPipelineModule (#20410) 2024-04-23 17:57:08 -07:00
tools Bump ruff to 0.3.2 and black to 24 (#19878) 2024-03-13 10:00:32 -07:00