onnxruntime/onnxruntime
Edward Chen 20cd3394fc
[MLAS] AArch64 SQNBitGemm CompInt8 initial multi-row implementation (#21193)
Update AArch64 SQNBitGemm CompInt8 kernels to process matrix in tiles. E.g., computing the output in 2x2 tiles allows us to compute four elements of the output with one read of two rows of A and two columns of B.

Also moved some code around as it was getting big for a single file.
2024-07-10 15:39:26 -07:00
..
contrib_ops Remove core/common/gsl.h (#20894) 2024-07-08 18:09:39 -07:00
core [MLAS] AArch64 SQNBitGemm CompInt8 initial multi-row implementation (#21193) 2024-07-10 15:39:26 -07:00
python Add MatMulNBits shape infer to SymbolicShapeInference (#21246) 2024-07-05 16:24:57 -07:00
test [MLAS] AArch64 SQNBitGemm CompInt8 initial multi-row implementation (#21193) 2024-07-10 15:39:26 -07:00
tool/etw
wasm [js/web] optimize module export and deployment (#20165) 2024-05-20 09:51:16 -07:00
__init__.py Bump up version in main from 1.18.0 to 1.19.0 (#20489) 2024-04-29 20:21:41 -07:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings