pengwa b457cfaa8f Enable conditional optimization automatically (#15885) ... ### Enable conditional optimization on inputs Label sparsity based optimization can be enabled depending on the input inspection result. So this PR introduce a conditional optimization path for ORTModule, where we automatically detect data sparsity from label or embedding, and enable the graph optimization accordingly without any user interaction. This feature had a new requirement of delaying passing pre_grad graph transformation config to OrtModuleGraphBuilder, from `Initialize` phase to its `Build` phase. Because once after `_initialize_graph_builder` we can detect the input sparsity, and make a decision to enable the label/embed sparisty based graph optimizations. Add UT cases for label/embed input runtime inspector.		2023-05-23 13:08:05 +08:00
..
deprecated	Adopt linrtunner as the linting tool - take 2 (#15085)	2023-03-24 15:29:03 -07:00
training	Enable conditional optimization automatically (#15885)	2023-05-23 13:08:05 +08:00
checkpointing_utils.py	Bump ruff in CI (#15533)	2023-04-17 10:11:44 -07:00
ort_trainer.py	Bump ruff in CI (#15533)	2023-04-17 10:11:44 -07:00
orttraining_pybind_common.h	Re-work global objects dependancies in pybind layer. (#14941)	2023-03-10 13:55:31 -08:00
orttraining_pybind_state.cc	Enable conditional optimization automatically (#15885)	2023-05-23 13:08:05 +08:00
orttraining_python_module.cc	Expose build information in dynamic lib (#15643)	2023-04-28 21:57:31 -07:00
orttraining_python_module_eager.h	Run clang-format in CI (#15524)	2023-04-18 09:26:58 -07:00
pt_patch.py	Adopt linrtunner as the linting tool - take 2 (#15085)	2023-03-24 15:29:03 -07:00