saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-31 23:27:43 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/tools/ci_build
History
Tang, Cheng 8f34c8c8ed
Introduce collective ops to ort inference build (#14399) 
### Description
Introduce collective ops into onnxruntime inference build, including
1) AllReduce and AllGather schema in contrib op, controlled by USE_MPI
flag
2) AllReduce and AllGather kernel in cuda EP, controlled by ORT_USE_NCCL
flag


### Motivation and Context
Enable the collective ops in onnxruntime inference build so we have the
ability to run distributed inference with multiple GPUs.
The original ncclAllReduce ops in training build require quite complex
configurations, which is not suitable for inference case, and it already
broken. so we introduce a new implementation.

---------

Co-authored-by: Cheng Tang <chenta@microsoft.com@orttrainingdev9.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net>
2023-02-07 13:47:48 -08:00
..
github Introduce collective ops to ort inference build (#14399) 2023-02-07 13:47:48 -08:00
__init__.py
amd_hipify.py [ROCm] Enable Sampling Op UT on AMD (#14581) 2023-02-06 20:52:06 -08:00
build.py Introduce collective ops to ort inference build (#14399) 2023-02-07 13:47:48 -08:00
clean_docker_image_cache.py
coverage.py
gen_def.py [oneDNN] Improved thread handling (#13618) 2023-01-31 14:37:13 -08:00
get_docker_image.py Improve dependency management (#13523) 2022-12-01 09:51:59 -08:00
logger.py
op_registration_utils.py Update kernel matching logic: decouple from op schemas and remove kernel def hashes (#12791) 2022-09-20 14:24:59 -07:00
op_registration_validator.py Update CUDA ArgMin/ArgMax op kernels to have end version 11 since opset 12+ is not supported yet. (#13983) 2022-12-21 19:01:00 -05:00
policheck_exclusions.xml Exculde hipify option from policheck (#13431) 2022-10-25 16:35:16 +08:00
reduce_op_kernels.py Update kernel matching logic: decouple from op schemas and remove kernel def hashes (#12791) 2022-09-20 14:24:59 -07:00
replace_urls_in_deps.py Move C/C++ deps' URLs to deps.txt (#13769) 2022-11-29 18:06:35 -08:00
requirements.txt upgrade protobuf to 3.20.2 and onnx to 1.13 (#14279) 2023-01-31 12:55:09 -08:00
update_tsaoptions.py Add license header to some files. (#13074) 2022-09-23 18:46:02 -07:00
upload_python_package_to_azure_storage.py