mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-17 18:40:28 +00:00
a80bfed5b4
### Description <!-- Describe your changes. --> Fix bugs in previous implementation and add more situations to go the optimized path. Below situations will go to the optimized path. 1. 2d inputs or squeezed 2d inputs 2. channels last or channels first transpose. For example, channel last transpose: [1, 256, 512, 512] -> [1, 512, 512, 256] For this case, the transpose becomes [256, 512x512] -> [512x512, 256] ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> For SD Turbo demo, the total transpose time becomes 39.98ms from 122.09ms. And the correspnding percents becomes 3.89% from 11.05% in this demo. This PR will also help #21618, the total transpose time in that demo becomes 17.32 ms from 70.25 ms on my iGPUs. |
||
|---|---|---|
| .. | ||
| _example.jsonc | ||
| abs-int32.jsonc | ||
| abs.jsonc | ||
| absr.jsonc | ||
| abss.jsonc | ||
| acos.jsonc | ||
| add.jsonc | ||
| add_int32.jsonc | ||
| add_zero-sized.jsonc | ||
| and.jsonc | ||
| asin.jsonc | ||
| attention.jsonc | ||
| batch-norm.jsonc | ||
| bias-add.jsonc | ||
| bias-split-gelu.jsonc | ||
| cast.jsonc | ||
| ceil.jsonc | ||
| clip.jsonc | ||
| concat.jsonc | ||
| concat_int32.jsonc | ||
| concat_zero-sized.jsonc | ||
| conv-transpose.jsonc | ||
| conv.jsonc | ||
| conv1d.jsonc | ||
| conv3dncdhw.jsonc | ||
| cos.jsonc | ||
| cumsum.jsonc | ||
| depth-to-space.jsonc | ||
| dequantize-linear-int4.jsonc | ||
| dequantizelinear.jsonc | ||
| div.jsonc | ||
| div_int32.jsonc | ||
| einsum.jsonc | ||
| equal.jsonc | ||
| exp.jsonc | ||
| expand.jsonc | ||
| fast-gelu.jsonc | ||
| floor.jsonc | ||
| fused-conv.jsonc | ||
| fused-conv3dncdhw.jsonc | ||
| gather-block-quantized.jsonc | ||
| gather-elements.jsonc | ||
| gather.jsonc | ||
| gelu.jsonc | ||
| gemm.jsonc | ||
| global-average-pool.jsonc | ||
| greater.jsonc | ||
| group-query-attention.jsonc | ||
| identity.jsonc | ||
| image-scaler.jsonc | ||
| instance-norm.jsonc | ||
| layer-norm.jsonc | ||
| leaky-relu.jsonc | ||
| less.jsonc | ||
| log.jsonc | ||
| matmul-broadcast.jsonc | ||
| matmul.jsonc | ||
| matmulnbits.jsonc | ||
| max-pool.jsonc | ||
| mul.jsonc | ||
| mul_int32.jsonc | ||
| multihead-attention.jsonc | ||
| neg-int32.jsonc | ||
| neg.jsonc | ||
| not.jsonc | ||
| or.jsonc | ||
| pad-big.jsonc | ||
| pad.jsonc | ||
| pad_f16.jsonc | ||
| pow-big-number.jsonc | ||
| pow.jsonc | ||
| pow_int32.jsonc | ||
| quick-gelu.jsonc | ||
| reduce-min.jsonc | ||
| relu.jsonc | ||
| reshape-int32.jsonc | ||
| reshape-pack.jsonc | ||
| reshape.jsonc | ||
| resize-pack.jsonc | ||
| resize.jsonc | ||
| rotary-embedding.jsonc | ||
| shape.jsonc | ||
| simplified-layer-norm.jsonc | ||
| sin.jsonc | ||
| skip-layer-norm.jsonc | ||
| skip-simplified-layer-norm.jsonc | ||
| slice.jsonc | ||
| softmax.jsonc | ||
| split.jsonc | ||
| sqrt.jsonc | ||
| sub.jsonc | ||
| sub_int32.jsonc | ||
| tan.jsonc | ||
| tanh.jsonc | ||
| tile.jsonc | ||
| transpose.jsonc | ||
| transpose_int32_uint32.jsonc | ||
| upsample.jsonc | ||
| where.jsonc | ||
| where_broadcast.jsonc | ||
| xor.jsonc | ||