onnxruntime/tools/ci_build/github/azure-pipelines
sfatimar 8dba8e3e24
Memory Optimization for Compilation in OVEP (#21872)
Calling Split API Calls Read+Model in lieu of unified Compile Model call
for export compile flow to ensure memory optimization. Freeing up model
proto and serialized string and read model ov ir later to free up memory
for the ahead pipeline
Optimization during EpCtxt flow
All the Graph related operations require all the Node Attributes to be
set while dealing with model instances internally with them, in the
existing implementation these attributes make a copy when constructing a
Graph dynamically during runtime.
Propose to use these attributes in place without creating a copy to
avoid memory allocation / copy while calling these Graph related
functions.
Changes to ensure the bug fixes related to openvino version and epctxt
file path.
Moving Compiler version to C++20 for getting r-value mem optimizations
benefit

### Motivation and Context
This change is required because memory optimization during Compilation
flow is too high.

---------

Co-authored-by: saurabhkale17 <saurabh1.kale@intel.com>
Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
Co-authored-by: Vishnudas Thaniel S <vishnudas.thaniel.s@intel.com>
Co-authored-by: Javier E. Martinez <javier.e.martinez@intel.com>
Co-authored-by: jatinwadhwa921 <110383850+jatinwadhwa921@users.noreply.github.com>
Co-authored-by: ankitm3k <ankit.maheshkar@intel.com>
Co-authored-by: jatinwadhwa921 <jatin.wadhwa@intel.com>
2024-09-03 13:52:31 -07:00
..
nodejs/templates Adding Job names to jobs without a name (#20961) 2024-06-06 19:09:21 -07:00
nuget/templates [Running CI] [TensorRT EP] support TensorRT 10.3-GA (#21742) 2024-08-18 13:26:41 -07:00
stages Removing docker_base_image parameter and variables (#21864) 2024-08-27 10:36:17 -07:00
templates Add dependency dawn into deps.txt (#21910) 2024-09-02 04:24:28 -07:00
triggers Pr trggiers generated by code (#17247) 2023-08-30 05:57:03 +08:00
android-arm64-v8a-QNN-crosscompile-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
android-x86_64-crosscompile-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
bigmodels-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
binary-size-checks-pipeline.yml Clean up some mobile package related files and their usages. (#21606) 2024-08-05 16:38:20 -07:00
build-perf-test-binaries-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
c-api-noopenmp-packaging-pipelines.yml Removing docker_base_image parameter and variables (#21864) 2024-08-27 10:36:17 -07:00
c-api-training-packaging-pipelines.yml Move on-device training packages publish step (#21539) 2024-07-29 09:59:46 -07:00
clean-build-docker-image-cache-pipeline.yml Upgrade Ubuntu machine pool from 20.04 to 22.04 (#19117) 2024-01-16 17:25:18 -08:00
cuda-packaging-pipeline.yml Removing docker_base_image parameter and variables (#21864) 2024-08-27 10:36:17 -07:00
linux-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-cpu-aten-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-cpu-eager-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-cpu-minimal-build-ci-pipeline.yml Update training packaging pipeline's docker files (#20853) 2024-05-30 23:48:42 -07:00
linux-dnnl-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-gpu-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-gpu-tensorrt-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-gpu-tensorrt-daily-perf-pipeline.yml [Running CI] [TensorRT EP] support TensorRT 10.3-GA (#21742) 2024-08-18 13:26:41 -07:00
linux-migraphx-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-openvino-ci-pipeline.yml Memory Optimization for Compilation in OVEP (#21872) 2024-09-03 13:52:31 -07:00
linux-qnn-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
linux-rocm-ci-pipeline.yml Add Linux ROCm CI Pipeline (#21798) 2024-08-30 14:50:32 +08:00
mac-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
mac-coreml-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
mac-ios-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
mac-ios-packaging-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
mac-react-native-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
npm-packaging-pipeline.yml Increase NPM ComponentDetection.Timeout: 1200 (#20681) 2024-05-15 13:41:59 -07:00
nuget-cuda-publishing-pipeline.yml Set CUDA12 as default in GPU packages (#21438) 2024-07-25 10:17:16 -07:00
orttraining-linux-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
orttraining-linux-gpu-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
orttraining-linux-gpu-ortmodule-distributed-test-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
orttraining-linux-nightly-ortmodule-test-pipeline.yml ORTModule memory improvement (#18924) 2024-01-16 08:57:37 +08:00
orttraining-mac-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
orttraining-pai-ci-pipeline.yml Replace inline pip install with pip install from requirements*.txt (#21106) 2024-07-22 12:39:10 -07:00
orttraining-py-packaging-pipeline-cpu.yml disables qnn in ort training cpu pipeline (#21510) 2024-07-26 17:23:35 +08:00
orttraining-py-packaging-pipeline-cuda.yml Update training packaging pipeline's docker files (#20853) 2024-05-30 23:48:42 -07:00
orttraining-py-packaging-pipeline-cuda12.yml Move Python Training CUDA 12.2 pipeline to another pool. (#21745) 2024-08-15 17:31:56 +08:00
orttraining-py-packaging-pipeline-rocm.yml [ROCm] Update ck to use ck_tile (#21030) 2024-06-19 14:06:10 +08:00
post-merge-jobs.yml [Running CI] [TensorRT EP] support TensorRT 10.3-GA (#21742) 2024-08-18 13:26:41 -07:00
publish-nuget.yml Move on-device training packages publish step (#21539) 2024-07-29 09:59:46 -07:00
py-cuda-package-test-pipeline.yml Adding new pipeline for python cuda testing (#18718) 2023-12-18 18:13:03 -08:00
py-cuda-packaging-pipeline.yml Remove manylinux build scripts from python packaging pipeline (#20786) 2024-05-24 08:18:22 -07:00
py-cuda-publishing-pipeline.yml Set CUDA12 as default in GPU packages (#21438) 2024-07-25 10:17:16 -07:00
py-package-build-pipeline.yml OpenVINO EP Rel 1.18 Changes (#20337) 2024-04-19 00:31:38 -07:00
py-package-test-pipeline.yml [Running CI] [TensorRT EP] support TensorRT 10.3-GA (#21742) 2024-08-18 13:26:41 -07:00
py-packaging-pipeline.yml support both qnn x64 and arm64ec stages in py packaging pipeline (#21880) 2024-08-27 15:07:30 -07:00
qnn-ep-nuget-packaging-pipeline.yml [QNN EP] Update QNN SDK to 2.25 (#21623) 2024-08-06 09:08:48 -07:00
rocm-nuget-packaging-pipeline.yml Make ROCm packaging stages to a single workflow (#21235) 2024-07-04 11:07:04 +08:00
web-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-ci-fuzz-testing.yml Uppdate nuget to Use Nuget 6.10.x (#21209) 2024-06-28 19:49:54 -07:00
win-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-gpu-cuda-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-gpu-dml-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-gpu-doc-gen-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-gpu-reduce-op-ci-pipeline.yml Move jobs in onnxruntime-Win2022-GPU-T4 machine pool to onnxruntime-Win2022-GPU-A10 (#21023) 2024-06-12 22:04:40 -07:00
win-gpu-tensorrt-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-gpu-training-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-qnn-arm64-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00
win-qnn-ci-pipeline.yml Add a reminder in set-trigger-rules script (#21929) 2024-08-30 12:18:10 -07:00