onnxruntime/orttraining
pengwa 55f63a48ca
Keep original name during fusion (#20097)
### Keep original name during fusion

This could be helpful to know where the fused node coming from, I feel
this is very useful when debugging the execution order issues between
different transformer layers.

For example:

- A node named
`/_original_module/model/layers.1/self_attn/MatMul/MatmulTransposeFusion//MatMulScaleFusion/`
goes through two fusion paths in the 1st transformer layer - e.g.
`MatmulTransposeFusion` and `MatMulScaleFusion`.

-
`/_original_module/model/layers.2/post_attention_layernorm/Mul_1/SimplifiedLayerNormFusion/`
node is a fused node by `SimplifiedLayerNormFusion`.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-03-28 08:40:34 +08:00
..
orttraining Keep original name during fusion (#20097) 2024-03-28 08:40:34 +08:00
tools Bump ruff to 0.3.2 and black to 24 (#19878) 2024-03-13 10:00:32 -07:00