Tianlei Wu 7aafd86229 Update Attention operator to support separated Q/K/V inputs (#13410) ... ### Description Allow separated Q, K and V inputs to support cross attention: * Q: [batch_size, sequence_length, hidden_size] * K: [batch_size, kv_sequence_length, hidden_size] * V: [batch_size, kv_sequence_length, v_hidden_size] * Output: [batch_size, sequence_length, v_hidden_size] To use separated Q/K/V inputs, the input tensor is for query, and two optional inputs are added for key and value. Weights for input projection is not included for now, so the MatMul of input projection shall be done out of Attention operator, but Add bias is included for performance consideration.		2022-10-25 11:51:06 -07:00
..
c_cxx	Document C/C++ API documentation version info conventions. (#10396)	2022-01-27 10:20:13 -08:00
execution_providers/images	Remove docs that have been migrated to https://onnxruntime.ai/docs (#6225)	2021-02-05 18:09:27 -08:00
images	API Documentation (#8948)	2021-09-09 22:04:51 -07:00
python	Bumping up version number to 1.14.0 on main branch (#13401)	2022-10-21 19:16:44 -04:00
ABI_Dev_Notes.md	skip windows GPU check if changes only in doc (#13248)	2022-10-11 13:51:44 +08:00
Android_testing.md	Removed BUILD.md from master as source now lives in gh-pages (#6709)	2021-02-19 11:34:21 -08:00
C_API_Guidelines.md	Replace 'master' branch ref to 'main' in the code (#12547)	2022-08-22 10:48:12 -07:00
cmake_guideline.md	fix some typo in docs (#13212)	2022-10-07 15:58:18 -07:00
Coding_Conventions_and_Standards.md	Fixed a minor typo (#13194)	2022-10-05 12:10:14 -07:00
ContribOperators.md	Update Attention operator to support separated Q/K/V inputs (#13410)	2022-10-25 11:51:06 -07:00
FAQ.md	Fix typo enviroment => environment (#13195)	2022-10-03 17:02:26 -07:00
How_To_Update_ONNX_Dev_Notes.md	Update script to find optimizers that potentially need supported opset updates (#12330)	2022-08-04 07:37:27 +10:00
Model_Test.md
NotesOnThreading.md	Replace 'master' branch ref to 'main' in the code (#12547)	2022-08-22 10:48:12 -07:00
ONNX_Runtime_Server_Usage.md	Update docs/ONNX_Runtime_Server_Usage.md (#7818)	2021-05-26 16:17:20 -07:00
onnxruntime_dependencies.dot	Update dependencies graph	2020-04-17 07:38:45 -07:00
onnxruntime_dependencies.png	Update dependencies graph	2020-04-17 07:38:45 -07:00
onnxruntime_extensions.md	replace 'master' branch ref to 'main' for onnx repo (#12678)	2022-08-30 13:41:42 -07:00
OperatorKernels.md	Update Attention operator to support separated Q/K/V inputs (#13410)	2022-10-25 11:51:06 -07:00
ORT_Format_Update_in_1.13.md	Update kernel matching logic: decouple from op schemas and remove kernel def hashes (#12791)	2022-09-20 14:24:59 -07:00
ORTMobilePackageOperatorTypeSupport.md	Replace 'master' branch ref to 'main' in the code (#12547)	2022-08-22 10:48:12 -07:00
PR_Guidelines.md	Add guidelines for writing a good PR. (#3830)	2020-05-05 16:28:21 -07:00
Privacy.md	[C# and Python APIs] Expose knobs to enable/disable platform telemetry collection (#5481)	2020-10-21 10:32:13 -07:00
Python_Dev_Notes.md	Changes related to the release binaries requiring Visual C++ 2019 runtime (#3871)	2020-05-12 17:07:06 -07:00
Reduced_Operator_Kernel_build.md	replace 'master' branch ref to 'main' for onnx repo (#12678)	2022-08-30 13:41:42 -07:00
ReleaseManagement.md	Updated TPN for OpenMPI and cleanup (#3932)	2020-05-14 11:42:44 -07:00
Roadmap.md	Replace 'master' branch ref to 'main' in the code (#12547)	2022-08-22 10:48:12 -07:00
Server.md	Update documentation for contributing a PR and add deprecation notices for PyOp and ORT server. (#6172)	2020-12-18 02:00:42 -08:00
TVM_EP.md	[C#][TVM EP] Fix issues related to using TVM EP in C# front-end (#12958)	2022-09-16 16:04:59 +02:00
Versioning.md	replace 'master' branch ref to 'main' for onnx repo (#12678)	2022-08-30 13:41:42 -07:00
WinML_principles.md	Replace 'master' branch ref to 'main' in the code (#12547)	2022-08-22 10:48:12 -07:00