onnxruntime/js/web/lib
Jiajia Qin 8159723ba7
[js/webgpu] Optimize matmulnbits (#22360)
### Description
<!-- Describe your changes. -->
This PR further optimizes matmulnbits specially for iGPUs. The phi3 demo
becomes ~12 tokens/second from ~8 tokens on iGPUs.

Some todos:
1. Make the optimization more general, Remove the blockSize = 32
limitation.
2. Tune the parameter, such as workgroupSize, components size (currently
only support components = 1), to see the performance change.
2024-10-14 15:49:29 -07:00
..
onnxjs [js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) 2024-08-14 16:51:22 -07:00
wasm [js/webgpu] Optimize matmulnbits (#22360) 2024-10-14 15:49:29 -07:00
backend-onnxjs.ts [js] change default formatter for JavaScript/TypeScript from clang-format to Prettier (#21728) 2024-08-14 16:51:22 -07:00
backend-wasm.ts [js/web] remove training release (#22103) 2024-09-16 10:56:22 -07:00
build-def.d.ts [js/web] allow build target for non dynamic import (#20898) 2024-06-03 12:33:37 -07:00
index.ts [js/web] remove training release (#22103) 2024-09-16 10:56:22 -07:00
version.ts bumps up version in main from 1.19 -> 1.20 (#21588) 2024-08-05 15:46:04 -07:00