onnxruntime/tools/ci_build/github/azure-pipelines
RandySheriffH 587e891cae
CloudEP (#13855)
Implement CloudEP for hybrid inferencing.
The PR introduces zero new API, customers could configure session and
run options to do inferencing with Azure [triton
endpoint.](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-deploy-with-triton?tabs=azure-cli%2Cendpoint)
Sample configuration in python be like:

```
sess_opt.add_session_config_entry('cloud.endpoint_type', 'triton');
sess_opt.add_session_config_entry('cloud.uri', 'https://cloud.com');
sess_opt.add_session_config_entry('cloud.model_name', 'detection2');
sess_opt.add_session_config_entry('cloud.model_version', '7'); // optional, default 1
sess_opt.add_session_config_entry('cloud.verbose', '1'); // optional, default '0', meaning no verbose
...
run_opt.add_run_config_entry('use_cloud', '1') # 0 for local inferencing, 1 for cloud endpoint.
run_opt.add_run_config_entry('cloud.auth_key', '...')
...
sess.run(None, {'input':input_}, run_opt)
```

Co-authored-by: Randy Shuai <rashuai@microsoft.com>
2023-01-03 10:03:15 -08:00
..
nodejs/templates
nuget/templates
templates CloudEP (#13855) 2023-01-03 10:03:15 -08:00
android-x86_64-crosscompile-ci-pipeline.yml
anybuild.yml
binary-size-checks-pipeline.yml
build-perf-test-binaries-pipeline.yml
c-api-noopenmp-packaging-pipelines.yml Update package pipelines to support TRT 8.5 (#13998) 2022-12-16 15:01:50 -08:00
clean-build-docker-image-cache-pipeline.yml
linux-ci-pipeline.yml [js] update versions of a few build dependencies (#13977) 2022-12-16 17:26:54 -08:00
linux-cpu-aten-pipeline.yml [js] update versions of a few build dependencies (#13977) 2022-12-16 17:26:54 -08:00
linux-cpu-eager-pipeline.yml
linux-cpu-minimal-build-ci-pipeline.yml
linux-dnnl-ci-pipeline.yml
linux-gpu-ci-pipeline.yml Add compilation cache for Linux GPU (#13995) 2022-12-16 16:38:12 +08:00
linux-gpu-tensorrt-ci-pipeline.yml [TensorRT EP] support TensorRT 8.5 (#13867) 2022-12-14 13:06:03 -08:00
linux-gpu-tensorrt-daily-perf-pipeline.yml Update package pipelines to support TRT 8.5 (#13998) 2022-12-16 15:01:50 -08:00
linux-gpu-tensorrt-packaging-pipeline.yml [TensorRT EP] support TensorRT 8.5 (#13867) 2022-12-14 13:06:03 -08:00
linux-migraphx-ci-pipeline.yml [ROCm] Update ROCm and MigraphX CI to ROCm5.4 (#14011) 2022-12-22 10:01:05 +08:00
linux-multi-gpu-ci-pipeline.yml
linux-multi-gpu-tensorrt-ci-pipeline.yml
linux-openvino-ci-pipeline.yml
linux-openvino-nightly-pipeline.yml
mac-ci-pipeline.yml FIX: macOS CI pipeline doesn't run tests (#13970) 2022-12-14 18:39:31 -08:00
mac-coreml-ci-pipeline.yml
mac-ios-ci-pipeline.yml
mac-ios-packaging-pipeline.yml
mac-objc-static-analysis-ci-pipeline.yml
mac-react-native-ci-pipeline.yml
npm-packaging-pipeline.yml
orttraining-linux-ci-pipeline.yml [js] update versions of a few build dependencies (#13977) 2022-12-16 17:26:54 -08:00
orttraining-linux-external-custom-ops.yml
orttraining-linux-gpu-amd-e2e-test-ci-pipeline.yml
orttraining-linux-gpu-ci-pipeline.yml
orttraining-linux-gpu-distributed-e2e-test-pipeline.yml
orttraining-linux-gpu-docker-release-pipeline.yml
orttraining-linux-gpu-on-device-training.yml
orttraining-linux-gpu-ortmodule-distributed-test-ci-pipeline.yml
orttraining-linux-gpu-ortmodule-test-clear-cache-pipeline.yml
orttraining-linux-nightly-ortmodule-test-pipeline.yml
orttraining-mac-ci-pipeline.yml
orttraining-pai-ci-pipeline.yml [ROCm] Update ROCm and MigraphX CI to ROCm5.4 (#14011) 2022-12-22 10:01:05 +08:00
orttraining-py-packaging-pipeline-cpu.yml
orttraining-py-packaging-pipeline-cuda116.yml
orttraining-py-packaging-pipeline-rocm.yml [ROCm] Add ROCm5.4 to python package pipeline (#14012) 2022-12-22 10:01:40 +08:00
post-merge-jobs.yml
py-package-build-pipeline.yml
py-package-test-pipeline.yml
py-packaging-pipeline.yml CloudEP (#13855) 2023-01-03 10:03:15 -08:00
python-checks-ci-pipeline.yml
sign_ov_ep_binaries.yml
snpe-ep-nuget-packaging-pipeline.yml
web-ci-pipeline.yml
web-packaging-pipeline.yml
win-ci-fuzz-testing.yml
win-ci-pipeline.yml CloudEP (#13855) 2023-01-03 10:03:15 -08:00
win-eager-ci-pipeline.yml
win-gpu-ci-pipeline.yml
win-gpu-reduce-op-ci-pipeline.yml
win-gpu-tensorrt-ci-pipeline.yml [TensorRT EP] support TensorRT 8.5 (#13867) 2022-12-14 13:06:03 -08:00