Tang, Cheng 8f34c8c8ed Introduce collective ops to ort inference build (#14399) ... ### Description Introduce collective ops into onnxruntime inference build, including 1) AllReduce and AllGather schema in contrib op, controlled by USE_MPI flag 2) AllReduce and AllGather kernel in cuda EP, controlled by ORT_USE_NCCL flag ### Motivation and Context Enable the collective ops in onnxruntime inference build so we have the ability to run distributed inference with multiple GPUs. The original ncclAllReduce ops in training build require quite complex configurations, which is not suitable for inference case, and it already broken. so we introduce a new implementation. --------- Co-authored-by: Cheng Tang <chenta@microsoft.com@orttrainingdev9.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net>		2023-02-07 13:47:48 -08:00
..
contrib_ops	Introduce collective ops to ort inference build (#14399)	2023-02-07 13:47:48 -08:00
core	Introduce collective ops to ort inference build (#14399)	2023-02-07 13:47:48 -08:00
python	Some kernel changes for TULR (#14517)	2023-02-07 11:51:06 -08:00
test	Introduce collective ops to ort inference build (#14399)	2023-02-07 13:47:48 -08:00
tool/etw
wasm	[wasm] fix session option setting of mem_pattern (#13858)	2022-12-07 13:15:44 -08:00
__init__.py	Bump ORT version number (#14226)	2023-01-26 12:33:47 -08:00
ReformatSource.ps1
ReformatSourcePython.bat
VSCodeCoverage.runsettings