saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-10 17:37:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/orttraining/orttraining/python/training/ortmodule/experimental
History
Adam Louly 4ce7bbf6f1
Add LayerSpec Support to ORTPipelineModule (#20410) 
### Description
In Deepspeed's Pipeline Parallel Implementation, there is a class used
to instantiate the object after it's moved to the device and assigned in
a stage.

This approach helps reduce peak memory usage. 

In this PR, we're adding support to ORT for wrapping this LayerSpec.
2024-04-23 17:57:08 -07:00
..
hierarchical_ortmodule
json_config
pipe Add LayerSpec Support to ORTPipelineModule (#20410) 2024-04-23 17:57:08 -07:00
__init__.py