saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-27 22:45:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

skip_infer for SkipGroupNorm in SymbolicShapeInference (#18630)

Browse source 
### Description
<!-- Describe your changes. -->
https://github.com/microsoft/onnxruntime/pull/18273 added
`SkipGroupNorm` contrib op but it did not skip onnx shape inference for
this op in `SymbolicShapeInference`.

This leads to failed shape inference of the transformers optimized model
with `enable_skip_group_norm=True`. Also results in an invalid float16
model for the SD CUDA example.

This PR adds `SkipGroupNorm` to `skip_infer` so that it skips onnx shape
inference for this op and instead uses the relevant dispatcher.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Fix shape inference failure for models with `SkipGroupNorm` nodes.
This commit is contained in:
Jambay Kinley 2023-11-29 18:27:04 -08:00 committed by GitHub
parent 227dcb3a88
commit c20488ced7
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
onnxruntime/python/tools/symbolic_shape_infer.py
View file

@ -467,6 +467,7 @@ class SymbolicShapeInference:
"PythonOp",
"MultiHeadAttention",
"GroupNorm",
"SkipGroupNorm",
"BiasSplitGelu",
"BiasAdd",
"NhwcConv",