mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-22 19:23:30 +00:00
424107a82a
### Description Merge main to WindowsAI ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> --------- Signed-off-by: Nash <george.nash@intel.com> Signed-off-by: Yiming Hu <yiming.hu@amd.com> Signed-off-by: Liqun Fu <liqfu@microsoft.com> Co-authored-by: Kaz Nishimura <kazssym@linuxfront.com> Co-authored-by: Tianlei Wu <tlwu@microsoft.com> Co-authored-by: Nat Kershaw (MSFT) <nakersha@microsoft.com> Co-authored-by: Yulong Wang <7679871+fs-eire@users.noreply.github.com> Co-authored-by: Changming Sun <chasun@microsoft.com> Co-authored-by: zesongw <zesong.wang@intel.com> Co-authored-by: Yi Zhang <zhanyi@microsoft.com> Co-authored-by: Dmitri Smirnov <yuslepukhin@users.noreply.github.com> Co-authored-by: Yifan Li <109183385+yf711@users.noreply.github.com> Co-authored-by: simonjub <78098752+simonjub@users.noreply.github.com> Co-authored-by: PeixuanZuo <94887879+PeixuanZuo@users.noreply.github.com> Co-authored-by: Adrian Lizarraga <adlizarraga@microsoft.com> Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com> Co-authored-by: Arthur Islamov <arthur@islamov.ai> Co-authored-by: Jambay Kinley <jambaykinley@microsoft.com> Co-authored-by: Justin Chu <justinchuby@users.noreply.github.com> Co-authored-by: Wei-Sheng Chin <wschin@outlook.com> Co-authored-by: Bowen Bao <bowbao@microsoft.com> Co-authored-by: Hariharan Seshadri <shariharan91@gmail.com> Co-authored-by: Numfor Tiapo <numsmt2@gmail.com> Co-authored-by: Vincent Wang <wangwchpku@outlook.com> Co-authored-by: Pranav Sharma <prs@microsoft.com> Co-authored-by: George Nash <george.nash@intel.com> Co-authored-by: Abhishek Jindal <abjindal@microsoft.com> Co-authored-by: pengwa <pengwa@microsoft.com> Co-authored-by: Yiming Hu <woinck@users.noreply.github.com> Co-authored-by: Jiajia Qin <jiajia.qin@intel.com> Co-authored-by: Lukas Berbuer <36054362+lukasberbuer@users.noreply.github.com> Co-authored-by: Wanming Lin <wanming.lin@intel.com> Co-authored-by: Xavier Dupré <xadupre@users.noreply.github.com> Co-authored-by: aimilefth <60664743+aimilefth@users.noreply.github.com> Co-authored-by: Baiju Meswani <bmeswani@microsoft.com> Co-authored-by: Adam Pocock <adam.pocock@oracle.com> Co-authored-by: Chi Lo <54722500+chilo-ms@users.noreply.github.com> Co-authored-by: RandySheriffH <48490400+RandySheriffH@users.noreply.github.com> Co-authored-by: Randy Shuai <rashuai@microsoft.com> Co-authored-by: Vadym Stupakov <vadim.stupakov@gmail.com> Co-authored-by: Jian Chen <cjian@microsoft.com> Co-authored-by: Brian Lambert <98757707+brian-pieces@users.noreply.github.com> Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com> Co-authored-by: liqun Fu <liqfu@microsoft.com> Co-authored-by: trajep <trajepl@gmail.com> Co-authored-by: Scott McKay <skottmckay@gmail.com> Co-authored-by: Mustafa Ateş Uzun <mustafauzun0@gmail.com> Co-authored-by: MistEO <mistereo@hotmail.com> Co-authored-by: satyajandhyala <satya.k.jandhyala@gmail.com> Co-authored-by: shaahji <96227573+shaahji@users.noreply.github.com> Co-authored-by: Rachel Guo <35738743+YUNQIUGUO@users.noreply.github.com> Co-authored-by: rachguo <rachguo@rachguos-Mini.attlocal.net> Co-authored-by: Caroline Zhu <wolfivyaura@gmail.com> Co-authored-by: Caroline Zhu <carolinezhu@microsoft.com> Co-authored-by: Guenther Schmuelling <guschmue@microsoft.com> Co-authored-by: xhcao <xinghua.cao@intel.com> Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com> Co-authored-by: Xu Xing <xing.xu@intel.com> Co-authored-by: Hector Li <hecli@microsoft.com> Co-authored-by: Ye Wang <52801275+wangyems@users.noreply.github.com> Co-authored-by: Your Name <you@example.com> Co-authored-by: Benedikt Hilmes <benedikt.hilmes@rwth-aachen.de> Co-authored-by: rachguo <rachguo@rachguos-Mac-mini.local> Co-authored-by: George Wu <jywu@microsoft.com> Co-authored-by: JiCheng <wejoncy@163.com> Co-authored-by: Sheil Kumar <smk2007@gmail.com> Co-authored-by: Sheil Kumar <sheilk@microsoft.com> Co-authored-by: cloudhan <guangyunhan@microsoft.com> Co-authored-by: kyoshisuki <143475866+kyoshisuki@users.noreply.github.com> Co-authored-by: aciddelgado <139922440+aciddelgado@users.noreply.github.com> Co-authored-by: tlwu@microsoft.com <tlwu@a100.crj0ad2y1kku1j4yxl4sj10o4e.gx.internal.cloudapp.net> Co-authored-by: Maximilian Müller <44298237+gedoensmax@users.noreply.github.com> Co-authored-by: Tang, Cheng <souptc@gmail.com> Co-authored-by: Cheng Tang <chenta@microsoft.com@orttrainingdev9.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net> Co-authored-by: Cheng Tang <chenta@microsoft.com> Co-authored-by: Jeff Daily <jeff.daily@amd.com> Co-authored-by: cloudhan <cloudhan@outlook.com> Co-authored-by: Yufeng Li <liyufeng1987@gmail.com> Co-authored-by: Zhang Lei <zhang.huanning@hotmail.com> Co-authored-by: Dwayne Robinson <fdwr@hotmail.com> Co-authored-by: Zhipeng Han <zhipeng.han@outlook.com> Co-authored-by: Thiago Crepaldi <thiago.crepaldi@microsoft.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Patrice Vignola <vignola.patrice@gmail.com> Co-authored-by: kunal-vaishnavi <115581922+kunal-vaishnavi@users.noreply.github.com> Co-authored-by: snadampal <87143774+snadampal@users.noreply.github.com> Co-authored-by: Sumit Agarwal <sumitagarwal330@gmail.com> Co-authored-by: Ashwini Khade <askhade@microsoft.com> Co-authored-by: Yang Gu <yang.gu@intel.com> Co-authored-by: Cheng Tang <chenta@a100.crj0ad2y1kku1j4yxl4sj10o4e.gx.internal.cloudapp.net> Co-authored-by: mindest <30493312+mindest@users.noreply.github.com> Co-authored-by: Scott McKay <Scott.McKay@microsoft.com> Co-authored-by: Xavier Dupre <xadupre@microsoft.com@orttrainingdev9.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net> Co-authored-by: guyang3532 <62738430+guyang3532@users.noreply.github.com> Co-authored-by: Carson M <carson@pyke.io> Co-authored-by: sophies927 <107952697+sophies927@users.noreply.github.com>
99 lines
4.3 KiB
Markdown
99 lines
4.3 KiB
Markdown
## Operators Support Table
|
|
|
|
The following table shows ONNX
|
|
operators and the supported opset domain/versions in WebGPU EP by ONNX Runtime Web. For example,
|
|
`4-6, 8+` means ONNX Runtime Web currently support opset version 4 to 6, 8 and above.
|
|
|
|
*This file is automatically generated from the
|
|
def files via [this script](../script/generate-webgpu-operator-md.ts).
|
|
Do not modify directly.*
|
|
|
|
| Operator | Opset | Comments |
|
|
|:--------:|:-------------:|-----|
|
|
| Abs | ai.onnx(6-12,13+) | |
|
|
| Acos | ai.onnx(7+) | |
|
|
| Acosh | ai.onnx(9+) | |
|
|
| Add | ai.onnx(7-12,13,14+) | |
|
|
| ArgMax | ai.onnx(1-10,11-12,13+) | |
|
|
| ArgMin | ai.onnx(1-10,11-12,13+) | |
|
|
| Asin | ai.onnx(7+) | |
|
|
| Asinh | ai.onnx(9+) | |
|
|
| Atan | ai.onnx(7+) | |
|
|
| Atanh | ai.onnx(9+) | |
|
|
| AveragePool | ai.onnx(7-9,10,11+); com.ms.internal.nhwc(11+) | need perf optimization; need implementing activation |
|
|
| BiasAdd | com.microsoft(1+) | |
|
|
| BiasSplitGelu | com.microsoft(1+) | |
|
|
| Cast | ai.onnx(6-8,9-12,13-18,19+) | |
|
|
| Ceil | ai.onnx(6-12,13+) | |
|
|
| Clip | ai.onnx(6-10,11,12,13+) | |
|
|
| Concat | ai.onnx(1-3,4-10,11-12,13+) | |
|
|
| Conv | ai.onnx(1-10,11+); com.ms.internal.nhwc(11+) | need perf optimization; conv3d is not supported; need implementing activation |
|
|
| ConvTranspose | ai.onnx(1-10,11+); com.ms.internal.nhwc(11+) | need perf optimization; ConvTranspose3d is not supported; need implementing activation |
|
|
| Cos | ai.onnx(7+) | |
|
|
| Cosh | ai.onnx(9+) | |
|
|
| Div | ai.onnx(7-12,13,14+) | |
|
|
| Einsum | ai.onnx(12+) | |
|
|
| Elu | ai.onnx(6+) | |
|
|
| Equal | ai.onnx(7-10,11-12,13-18,19+) | |
|
|
| Erf | ai.onnx(9-12,13+) | |
|
|
| Exp | ai.onnx(6-12,13+) | |
|
|
| Expand | ai.onnx(8-12,13+) | |
|
|
| Flatten | ai.onnx(1-8,9-10,11-12,13+) | |
|
|
| Floor | ai.onnx(6-12,13+) | |
|
|
| Gather | ai.onnx(1-10,11-12,13+) | |
|
|
| GatherElements | ai.onnx(11-12,13+) | |
|
|
| Gelu | com.microsoft(1+) | |
|
|
| Gemm | ai.onnx(7-8,9-10,11-12,13+) | |
|
|
| GlobalAveragePool | ai.onnx(1+); com.ms.internal.nhwc(1+) | |
|
|
| GlobalMaxPool | ai.onnx(1+); com.ms.internal.nhwc(1+) | |
|
|
| Greater | ai.onnx(7-8,9-12,13+) | |
|
|
| GreaterOrEqual | ai.onnx(12-15,16+) | |
|
|
| If | ai.onnx(1-10,11-12,13-18,19+) | |
|
|
| InstanceNormalization | ai.onnx(6+); com.ms.internal.nhwc(6+) | |
|
|
| LayerNormalization | ai.onnx(17+) | |
|
|
| LeakyRelu | ai.onnx(6-15,16+) | |
|
|
| Less | ai.onnx(7-8,9-12,13+) | |
|
|
| LessOrEqual | ai.onnx(12-15,16+) | |
|
|
| Log | ai.onnx(6-12,13+) | |
|
|
| MatMul | ai.onnx(1-12,13+) | |
|
|
| MaxPool | ai.onnx(1-7,8-9,10,11,12+); com.ms.internal.nhwc(11,12+) | need perf optimization; need implementing activation |
|
|
| MemcpyFromHost | ai.onnx(1+) | |
|
|
| MemcpyToHost | ai.onnx(1+) | |
|
|
| Mul | ai.onnx(7-12,13,14+) | |
|
|
| Neg | ai.onnx(6-12,13+) | |
|
|
| Not | ai.onnx(1+) | |
|
|
| Pad | ai.onnx(2-10,11-12,13-17,18,19+) | |
|
|
| Pow | ai.onnx(7-11,12,13-14,15+) | |
|
|
| Range | ai.onnx(11+) | |
|
|
| Reciprocal | ai.onnx(6-12,13+) | |
|
|
| ReduceL1 | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceL2 | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceLogSum | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceLogSumExp | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceMax | ai.onnx(1-10,11,12,13-17,18+) | |
|
|
| ReduceMean | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceMin | ai.onnx(1-10,11,12,13-17,18+) | |
|
|
| ReduceProd | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| ReduceSum | ai.onnx(1-10,11-12,13+) | |
|
|
| ReduceSumSquare | ai.onnx(1-10,11-12,13-17,18+) | |
|
|
| Relu | ai.onnx(6-12,13,14+) | |
|
|
| Reshape | ai.onnx(5-12,13,14+) | no GPU kernel |
|
|
| Resize | ai.onnx(10,11-12,13-17,18,19+); com.ms.internal.nhwc(11-12,13-17,18,19+) | CoordinateTransformMode align_corners is not supported with downsampling |
|
|
| Shape | ai.onnx(1-12,13-14,15+) | no GPU kernel; an ORT warning is generated - need to fix |
|
|
| Sigmoid | ai.onnx(6-12,13+) | |
|
|
| Sin | ai.onnx(7+) | |
|
|
| Sinh | ai.onnx(9+) | |
|
|
| SkipLayerNormalization | com.microsoft(1+) | |
|
|
| Slice | ai.onnx(1-9,10,11-12,13+) | |
|
|
| Softmax | ai.onnx(1-10,11-12,13+) | |
|
|
| Split | ai.onnx(1,2-10,11-12,13-17,18+) | |
|
|
| Sqrt | ai.onnx(6-12,13+) | |
|
|
| Squeeze | ai.onnx(1-10,11-12,13+) | |
|
|
| Sub | ai.onnx(7-12,13,14+) | |
|
|
| Tan | ai.onnx(7+) | |
|
|
| Tanh | ai.onnx(6-12,13+) | |
|
|
| ThresholdedRelu | ai.onnx(10+) | |
|
|
| Tile | ai.onnx(6-12,13+) | |
|
|
| Transpose | ai.onnx(1-12,13+) | need perf optimization |
|
|
| Unsqueeze | ai.onnx(1-10,11-12,13+) | |
|
|
| Where | ai.onnx(9-15,16+) | |
|