saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-26 19:52:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix GQA shape inference (#18723)

Browse source 
The shape inference is always returning before getting the chance to
infer the key/value outputs.
This commit is contained in:
Patrice Vignola 2023-12-10 21:36:19 -08:00 committed by GitHub
parent de32baeeef
commit 8d641229e6
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
onnxruntime/core/graph/contrib_ops/bert_defs.cc
View file

@ -259,7 +259,6 @@ void GroupQueryAttentionTypeAndShapeInference(ONNX_NAMESPACE::InferenceContext&
*output_shape.add_dim() = query_dims[1];
*output_shape.add_dim() = query_dims[2];
updateOutputShape(ctx, 0, output_shape);
return;
} else {
fail_shape_inference("Missing input 2 (value)");
}