onnxruntime/tools/ci_build/github/azure-pipelines
Edward Chen 71e7c2b423
Cache build docker images in container registry. (#5811)
This PR adds infrastructure to automatically cache docker images used in CI builds in a container registry.

Currently, build images are pulled from a container registry for some builds and built every time for others. The container registry requires maintenance to keep the images up to date and building images every time wastes build agent resources.

With this change, a given build image can be looked up in a cache container registry and if present, pulled, and otherwise, built and pushed. The uniqueness of a build image is determined by a hash digest of the dockerfile, docker build context directory, and certain "docker build" options. This digest is part of the image tag in the cache container repository.

The cache container registry will need to be cleaned up periodically. This is not automated yet.
2020-11-17 17:02:24 -08:00
..
nodejs update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
nuget Switch to unified DirectML 1.4.0 redistributable (#5794) 2020-11-17 13:42:23 -08:00
templates Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
android-x86_64-crosscompile-ci-pipeline.yml Android CI update (#5474) 2020-10-14 16:56:50 -07:00
c-api-packaging-pipelines.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
centos-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
featurizers-py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
java-api-packaging-pipelines-gpu.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
java-api-packaging-pipelines.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-cpu-minimal-build-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-dnnl-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-cuda-11-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-gpu-tensorrt-ci-perf-pipeline.yml Tensorrt perf tool (#5436) 2020-11-06 12:27:42 -08:00
linux-gpu-tensorrt-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-multi-gpu-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-multi-gpu-tensorrt-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-ngraph-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-nocontribops-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
linux-nuphar-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-openvino-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-openvino-nightly-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
linux-ort-srv-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-ort-srv-nightly-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
linux-pytorch-custom-ops-ci-pipeline.yml Avoid building ONNX of every history ONNX versions in our CI (#4678) 2020-08-03 10:18:10 -07:00
mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
mac-ios-ci-pipeline.yml Enable iOS CI pipeline (#5360) 2020-10-02 20:14:45 -07:00
mac-nocontribops-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-linux-ci-pipeline.yml update onnx commit id (#5594) 2020-11-02 09:46:36 -08:00
orttraining-linux-gpu-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
orttraining-linux-gpu-docker-release-pipeline.yml Docker image release build updates (#5326) 2020-10-01 12:25:31 -07:00
orttraining-linux-gpu-e2e-test-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
orttraining-linux-gpu-e2e-test-nightly-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
orttraining-linux-gpu-frontend-test-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
orttraining-linux-gpu-perf-test-ci-pipeline.yml Cache build docker images in container registry. (#5811) 2020-11-17 17:02:24 -08:00
orttraining-mac-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-pai-ci-pipeline.yml ROCm EP for AMD GPU (#5480) 2020-10-29 17:13:04 -07:00
orttraining-py-packaging-pipeline.yml Refactor manylinux docker image and the related pipelines (#4751) 2020-08-17 09:40:31 -07:00
orttraining-win-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
orttraining-win-gpu-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
post-merge-jobs.yml jobs timeout .. 2020-09-21 21:51:59 -07:00
py-packaging-pipeline.yml Refactor Python packaging builds (#4283) 2020-06-22 17:13:22 -07:00
win-arm-crosscompile-ci-pipeline.yml Merge windowsai (winml layering) into master (#2956) 2020-02-04 17:12:19 -08:00
win-arm64-crosscompile-ci-pipeline.yml Merge windowsai (winml layering) into master (#2956) 2020-02-04 17:12:19 -08:00
win-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-gpu-ci-pipeline.yml Merge pull request #5731 from microsoft/snnn/rtti 2020-11-10 09:02:59 -08:00
win-gpu-cuda-11-pipeline.yml Merge pull request #5731 from microsoft/snnn/rtti 2020-11-10 09:02:59 -08:00
win-gpu-reduce-op-ci-pipeline.yml Promote Cuda version to 10.2 for windows pipelines (#5138) 2020-09-13 20:32:06 -07:00
win-gpu-tensorrt-ci-pipeline.yml Enable rejecting models based on onnx opset (#4912) 2020-08-31 13:35:36 -07:00
win-ngraph-ci-pipeline.yml Revert "remove openmp and scipy from build pipelines (#4305)" 2020-07-02 00:30:02 -07:00
win-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00
win-x86-nocontribops-ci-pipeline.yml Fix nuget build (#5163) 2020-09-16 10:37:09 -07:00