onnxruntime/onnxruntime
Tianlei Wu 9407c3270c
GPT-2 attention fusion for transformers >= 4.27 (#16461)
### Description
Before transformers 4.27, the causal mask uses uint8 data type, so there
is extra Cast node to convert it to bool. This adds a pattern that
without Cast node to support attention fusion for GPT-2 models exported
with transformers >= 4.27.

### Motivation and Context

https://github.com/microsoft/onnxruntime/issues/16453
2023-06-23 15:38:35 -07:00
..
contrib_ops Add license header to CUDA related files (#16437) 2023-06-21 13:31:43 -07:00
core Remove now duplicated symbol (#16458) 2023-06-23 09:21:03 -07:00
python GPT-2 attention fusion for transformers >= 4.27 (#16461) 2023-06-23 15:38:35 -07:00
test Minimal Build for On-Device Training (#16326) 2023-06-22 12:27:23 -07:00
tool/etw Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
wasm [js/web] enable ONNX Runtime Web error messages in JS (#16335) 2023-06-15 09:45:41 -07:00
__init__.py ExecutionProvider API refactor - move allocator from EP level to SessionState level and indexed by OrtDevice (#15833) 2023-06-19 17:44:45 -07:00
ReformatSource.ps1 Run clang-format in CI (#15524) 2023-04-18 09:26:58 -07:00
ReformatSourcePython.bat
VSCodeCoverage.runsettings