pengwa 516c8e95fa Optimize SCE loss compute (#15401) ... ### Optimize SCE loss compute Compute optimization based on label data sparsity: - Insert ShrunkenGather before SCELoss node, to filter out invalid labels for compute. - Support ShrunkenGather upstream. - Added test for the above. - Added flag to enable label sparsity optimization with env var, by default disabled now. Will enable after comprehensive benchmarking later. - Extract common logic into test_optimizer_utils.h/cc from core/optimizer/compute_optimzier_test.cc, then the common functions can be shared by both core/optimizer/compute_optimzier_test.cc and orttraining/core/optimizer/compute_optimzier_test.cc - Extract common logic into shared_utils.h/cc: `GetONNXOpSetVersion` and `Create1DInitializerFromVector` ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. -->		2023-04-13 13:02:12 +08:00
..
orttraining	Optimize SCE loss compute (#15401)	2023-04-13 13:02:12 +08:00
pytorch_frontend_examples	Enable pylint and numpy rules (#15218)	2023-03-27 20:37:53 -07:00
tools	Enable pylint and numpy rules (#15218)	2023-03-27 20:37:53 -07:00