onnxruntime/onnxruntime
Chen Fu 26abaeb284
Fix half precision gemm test accumulation error (#14842)
### Description

Half precision gemm test requirement relaxation

### Motivation and Context

Most CPUs does not support mixed precision accumulation, only mul & add
fuse. As a result, different striding on the K dimension may lead to
rounding error. Accumulation of these rounding error maybe very
significant. So setting an approximation ratio does NOT always work.
What's more, a relaxed test condition may hide real implementation
problem. So this is only a compromised fix.

More rigorous tests require manual efforts:
1. Change the K stride of the kernel under test to be 16.
2. Force the K stride of the fp16 kernel to 16
3. Change the test oracle to be exact match.
4. Pass this test and then change it back :-(.

Co-authored-by: Chen Fu <fuchen@microsoft.com>
2023-02-27 13:23:14 -08:00
..
contrib_ops Fix prefast warnings in CUDA ops (#14814) 2023-02-24 21:23:08 -08:00
core Fix type mismatch in CUDA Trilu op. (#12863) 2023-02-24 23:24:26 -08:00
python Fix ValueError when testing PyTorch performance (#14450) 2023-02-24 21:39:14 -08:00
test Fix half precision gemm test accumulation error (#14842) 2023-02-27 13:23:14 -08:00
tool/etw
wasm [js/web] support flag 'optimizedModelFilePath' in session options (#14355) 2023-02-24 15:50:15 -08:00
__init__.py Bump ORT version number (#14226) 2023-01-26 12:33:47 -08:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings