onnxruntime/onnxruntime
aciddelgado 4a196d1594
Packed QKV and Rotary Embedding Support for sm<80 GQA (#20012)
### Description
Add support for packed qkv input and rotary embedding with sm<80 using
memory efficient attention kernel.



### Motivation and Context
Allows lower-end gpus to run gqa with packed qkv input and rotary
embedding.
2024-03-23 14:30:35 -07:00
..
contrib_ops Packed QKV and Rotary Embedding Support for sm<80 GQA (#20012) 2024-03-23 14:30:35 -07:00
core Fix issue that failed to load Conv node with external initializer (#20042) 2024-03-23 13:43:20 -07:00
python [QDQ Quant] Support mixed-precision integer quantization via overrides (#19925) 2024-03-23 11:05:08 -07:00
test Packed QKV and Rotary Embedding Support for sm<80 GQA (#20012) 2024-03-23 14:30:35 -07:00
tool/etw
wasm [js/web] rewrite backend resolve to allow multiple EPs (#19735) 2024-03-15 11:47:45 -07:00
__init__.py [ORT 1.17.0 release] Bump up version to 1.18.0 (#19170) 2024-01-17 11:18:32 -08:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings