saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-26 22:35:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
11445 commits 2856 branches 57 tags 1.3 GiB
Commit graph

1 commit

Author SHA1 Message Date
Xu Xing
8c59cd4fce
[js/webgpu] Support GroupQueryAttention (#20237) 
TODOs:
1. Handle H * params.kvNumHeads greater than work group size limit.
2. Support BNSH kv cache.
 2024-05-13 09:43:37 -07:00