RandySheriffH 587e891cae CloudEP (#13855) ... Implement CloudEP for hybrid inferencing. The PR introduces zero new API, customers could configure session and run options to do inferencing with Azure [triton endpoint.](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-with-triton?tabs=azure-cli%2Cendpoint) Sample configuration in python be like: ``` sess_opt.add_session_config_entry('cloud.endpoint_type', 'triton'); sess_opt.add_session_config_entry('cloud.uri', 'https://cloud.com'); sess_opt.add_session_config_entry('cloud.model_name', 'detection2'); sess_opt.add_session_config_entry('cloud.model_version', '7'); // optional, default 1 sess_opt.add_session_config_entry('cloud.verbose', '1'); // optional, default '0', meaning no verbose ... run_opt.add_run_config_entry('use_cloud', '1') # 0 for local inferencing, 1 for cloud endpoint. run_opt.add_run_config_entry('cloud.auth_key', '...') ... sess.run(None, {'input':input_}, run_opt) ``` Co-authored-by: Randy Shuai <rashuai@microsoft.com>		2023-01-03 10:03:15 -08:00
..
docker	Fix nightly ort training ci pipeline (#14007)	2022-12-30 12:28:57 -08:00
ort_minimal	Add build configuration to binary size checks pipeline. (#13208)	2022-10-05 12:39:19 -07:00
tvm	Bump protobuf from 3.18.1 to 3.18.3 in /tools/ci_build/github/linux/tvm	2022-09-24 21:12:16 -07:00
build_cuda_c_api_package.sh	Remove git and python packages from the docker images used by Zip-Nuget-Java-Nodejs Packaging Pipeline (#11651)	2022-06-03 20:00:54 -07:00
build_linux_arm64_python_package.sh	CloudEP (#13855)	2023-01-03 10:03:15 -08:00
build_yocto.sh
copy_strip_binary.sh	include coreml_provider_factory.h in macos build instead of coreml_ex… (#12138)	2022-07-11 18:27:01 -07:00
create_package.sh
extract_and_bundle_gpu_package.sh	Remove git and python packages from the docker images used by Zip-Nuget-Java-Nodejs Packaging Pipeline (#11651)	2022-06-03 20:00:54 -07:00
java_copy_strip_binary.sh	Change native folder name for java macos arm64 (#12335)	2022-07-27 15:13:07 -07:00
java_linux_final_test.sh	Update protobuf-java to version 3.21.7 (#13630)	2022-11-17 15:04:42 -08:00
run_build.sh	Remove unused git submodules (#13830)	2022-12-07 21:59:16 -08:00
run_dockerbuild.sh	Update package pipelines to support TRT 8.5 (#13998)	2022-12-16 15:01:50 -08:00
run_python_dockerbuild.sh	CloudEP (#13855)	2023-01-03 10:03:15 -08:00
run_python_tests.sh	Add license header to some files. (#13074)	2022-09-23 18:46:02 -07:00
test_custom_ops_pytorch_export.sh
upload_code_coverage_data.sh	Pin version of post to dashboard scripts' dependencies and update them to work with recent version. (#10353)	2022-01-21 19:35:58 -08:00
upload_ortsrv_binaries.sh
yocto_build_toolchain.sh