onnxruntime/onnxruntime
PeixuanZuo 28f470c26c
[ROCm] Use SkipLayerNorm original implementation in kernel explorer (#13382)
### Description
<!-- Describe your changes. -->

Wrap SkipLayerNormoriginal implementation as a function.
Use it as part of SkipLayerNormTunableOp.
Use it in Kernel explorer to compare the gap between TunableOp and
Original implementation.

the profile output like below:
`float16 8 512 768 <class
'_kernel_explorer.SkipLayerNorm_half_Original'> 23.48 us 804.04 GB/s

float16 8 512 768 <class '_kernel_explorer.SkipLayerNorm_half_Tunable'>
20.41 us 925.00 GB/s
...`

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

Co-authored-by: peixuanzuo <peixuanzuo@linmif39a000004.zvflicr54joexhdgnhvmxrxygg.phxx.internal.cloudapp.net>
2022-10-24 22:00:24 -07:00
..
contrib_ops [ROCm] Use SkipLayerNorm original implementation in kernel explorer (#13382) 2022-10-24 22:00:24 -07:00
core Drop hip_add_library (#13406) 2022-10-25 12:57:48 +08:00
gsl
python [ROCm] Use SkipLayerNorm original implementation in kernel explorer (#13382) 2022-10-24 22:00:24 -07:00
test skip some models failed in dynamic shape infer (#13400) 2022-10-25 01:48:46 +08:00
tool/etw
wasm [js/web] add 'xnnpack' to EP list (#12723) 2022-10-03 10:38:45 -07:00
__init__.py Bumping up version number to 1.14.0 on main branch (#13401) 2022-10-21 19:16:44 -04:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings