mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-07-23 19:32:23 +00:00
QGemm takes in quantized A, B, C, and quantization parameters of output Y, in which C and quantization parameters of Y are optional. Its output can be quantized or full precision, which depends on whether quantization parameters of Y exists or not. If quant params of Y are provided, the output will be requantized or is full precision. Comparing with QLinearMatMul and MatMulInteger, QGemm supports transpose, apha and beta attribute. The formula for quantized GEMM is: Y = alpha * scale_a * scale_b * ((A_int8 - zp_a) * (B_int8 - zp_b) + C_int32), in which, C_int32 is quantized with formula: C_int32 = (beta * C) / (alpha * scale_a * scale_b) |
||
|---|---|---|
| .. | ||
| logging | ||
| cuda_op_test_utils.h | ||
| denormal_test.cc | ||
| path_test.cc | ||
| quantization_test_utils.h | ||
| string_utils_test.cc | ||
| tensor_op_test_utils.cc | ||
| tensor_op_test_utils.h | ||
| utf8_util_test.cc | ||