mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-05-15 20:50:42 +00:00
8dba8e3e24
Calling Split API Calls Read+Model in lieu of unified Compile Model call for export compile flow to ensure memory optimization. Freeing up model proto and serialized string and read model ov ir later to free up memory for the ahead pipeline Optimization during EpCtxt flow All the Graph related operations require all the Node Attributes to be set while dealing with model instances internally with them, in the existing implementation these attributes make a copy when constructing a Graph dynamically during runtime. Propose to use these attributes in place without creating a copy to avoid memory allocation / copy while calling these Graph related functions. Changes to ensure the bug fixes related to openvino version and epctxt file path. Moving Compiler version to C++20 for getting r-value mem optimizations benefit ### Motivation and Context This change is required because memory optimization during Compilation flow is too high. --------- Co-authored-by: saurabhkale17 <saurabh1.kale@intel.com> Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com> Co-authored-by: Vishnudas Thaniel S <vishnudas.thaniel.s@intel.com> Co-authored-by: Javier E. Martinez <javier.e.martinez@intel.com> Co-authored-by: jatinwadhwa921 <110383850+jatinwadhwa921@users.noreply.github.com> Co-authored-by: ankitm3k <ankit.maheshkar@intel.com> Co-authored-by: jatinwadhwa921 <jatin.wadhwa@intel.com> |
||
|---|---|---|
| .. | ||
| inference | ||
| scripts | ||
| Dockerfile.aten_cpu | ||
| Dockerfile.lort_cpu | ||
| Dockerfile.manylinux2_28_cpu | ||
| Dockerfile.manylinux2_28_cuda | ||
| Dockerfile.manylinux2_28_rocm | ||
| Dockerfile.manylinux2_28_training_cuda11_8 | ||
| Dockerfile.manylinux2_28_training_cuda12_2 | ||
| Dockerfile.package_ubi8_cuda11_8_tensorrt8_6 | ||
| Dockerfile.package_ubi8_cuda_tensorrt10_0 | ||
| Dockerfile.package_ubi8_cuda_tensorrt10_0_torch | ||
| Dockerfile.package_ubuntu_2004_gpu | ||
| Dockerfile.package_ubuntu_2004_gpu_ffmpeg | ||
| Dockerfile.ubuntu_cuda11_8_tensorrt8_6 | ||
| Dockerfile.ubuntu_cuda11_tensorrt10 | ||
| Dockerfile.ubuntu_cuda12_3_tensorrt8_6 | ||
| Dockerfile.ubuntu_cuda12_tensorrt10 | ||
| Dockerfile.ubuntu_gpu_training | ||
| Dockerfile.ubuntu_openvino | ||
| Dockerfile.ubuntu_tensorrt_bin | ||
| manylinux.patch | ||
| migraphx-ci-pipeline-env.Dockerfile | ||
| rocm-ci-pipeline-env.Dockerfile | ||