onnxruntime/cmake
Ankit Maheshkar a6ea57b8f3
OpenVINO EP Weights Sharing Feature (#23553)
### Description
These changes are done to ensure that weight sharing happens between two model using session context option ep_weight_sharing.

Key changes introduced in this feature are:

Creating a shared context between two models Extracting external constant initializers and re labelling them back as
inputs to the model to allow weight loading in the direct blob. Creating EP Context Nodes when Subgraph partitioning is happening.

### Motivation and Context
This change was required to ensure that LLM with prefill and kvcache models can use the same share
The change was also required to ensure EP Context nodes can be formed even when model is being subgraph partitioned.

---------

Co-authored-by: jatinwadhwa921 <jatin.wadhwa@intel.com>
Co-authored-by: jatinwadhwa921 <110383850+jatinwadhwa921@users.noreply.github.com>
Co-authored-by: saurabh <saurabh1.kale@intel.com>
Co-authored-by: TejalKhade28 <tejal.khade@intel.com>
Co-authored-by: sfatimar <sahar.fatima@intel.com>
Co-authored-by: Javier E. Martinez <javier.e.martinez@intel.com>
Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
Co-authored-by: Eric Crawford <eric.r.crawford@intel.com>
2025-02-06 14:57:38 -08:00
..
external Enable VCPKG in more pipelines (#23590) 2025-02-06 10:10:31 -08:00
patches remove log spam from cpuinfo (#23548) 2025-01-31 18:16:24 -08:00
tensorboard
vcpkg-ports Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
vcpkg-triplets Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
adjust_global_compile_flags.cmake Update ORT extension to the latest (#23314) 2025-01-13 18:59:42 -08:00
arm64x.cmake
CMakeLists.txt Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
CMakePresets.json Correct ONNX and Protobuf version in vcpkg build (#23285) 2025-01-08 12:25:17 -08:00
CMakeSettings.json
codeconv.runsettings
deps.txt [TensorRT EP] support TensorRT 10.8-GA (#23592) 2025-02-06 10:05:57 -08:00
EnableVisualStudioCodeAnalysis.props
gdk_toolchain.cmake
hip_fatbin_insert
Info.plist.in
libonnxruntime.pc.cmake.in
linux_arm32_crosscompile_toolchain.cmake
linux_arm64_crosscompile_toolchain.cmake
maccatalyst_prepare_objects_for_prelink.py
nuget_helpers.cmake
onnxruntime.cmake [QNN EP] Make QNN EP a shared library (#23120) 2025-01-22 12:11:00 -08:00
onnxruntime_common.cmake
onnxruntime_compile_triton_kernel.cmake
onnxruntime_config.h.in Pre-requisites of upgrading EMSDK (#23347) 2025-01-14 11:07:21 -08:00
onnxruntime_csharp.cmake
onnxruntime_flatbuffers.cmake
onnxruntime_framework.cmake Enable VCPKG in more pipelines (#23590) 2025-02-06 10:10:31 -08:00
onnxruntime_framework.natvis
onnxruntime_fuzz_test.cmake
onnxruntime_graph.cmake
onnxruntime_ios.toolchain.cmake
onnxruntime_java.cmake [QNN EP] Make QNN EP a shared library (#23120) 2025-01-22 12:11:00 -08:00
onnxruntime_java_unittests.cmake
onnxruntime_kernel_explorer.cmake
onnxruntime_lora.cmake
onnxruntime_mlas.cmake [ARM CPU] hgemm optimized for gqa (#23107) 2025-01-24 15:25:24 -08:00
onnxruntime_nodejs.cmake
onnxruntime_objectivec.cmake
onnxruntime_opschema_lib.cmake
onnxruntime_optimizer.cmake Update Linux docker images (#23244) 2025-01-09 10:20:33 -08:00
onnxruntime_providers.cmake [QNN EP] Make QNN EP a shared library (#23120) 2025-01-22 12:11:00 -08:00
onnxruntime_providers_acl.cmake
onnxruntime_providers_armnn.cmake
onnxruntime_providers_azure.cmake
onnxruntime_providers_cann.cmake
onnxruntime_providers_coreml.cmake Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
onnxruntime_providers_cpu.cmake Enable VCPKG in more pipelines (#23590) 2025-02-06 10:10:31 -08:00
onnxruntime_providers_cuda.cmake
onnxruntime_providers_dml.cmake
onnxruntime_providers_dnnl.cmake
onnxruntime_providers_js.cmake
onnxruntime_providers_migraphx.cmake
onnxruntime_providers_nnapi.cmake
onnxruntime_providers_openvino.cmake OpenVINO EP Weights Sharing Feature (#23553) 2025-02-06 14:57:38 -08:00
onnxruntime_providers_qnn.cmake [QNN EP] Make QNN EP a shared library (#23120) 2025-01-22 12:11:00 -08:00
onnxruntime_providers_rknpu.cmake
onnxruntime_providers_rocm.cmake
onnxruntime_providers_tensorrt.cmake Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
onnxruntime_providers_vitisai.cmake
onnxruntime_providers_vsinpu.cmake
onnxruntime_providers_webgpu.cmake [WebGPU] allow build WebGPU EP for WebAssembly (#23364) 2025-01-16 10:52:17 -08:00
onnxruntime_providers_webnn.cmake
onnxruntime_providers_xnnpack.cmake
onnxruntime_python.cmake Enable VCPKG in more pipelines (#23590) 2025-02-06 10:10:31 -08:00
onnxruntime_rocm_hipify.cmake
onnxruntime_session.cmake
onnxruntime_snpe_provider.cmake
onnxruntime_training.cmake
onnxruntime_unittests.cmake Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
onnxruntime_util.cmake
onnxruntime_visionos.toolchain.cmake
onnxruntime_webassembly.cmake [WebGPU] allow build WebGPU EP for WebAssembly (#23364) 2025-01-16 10:52:17 -08:00
precompiled_header.cmake
riscv64.toolchain.cmake
Sdl.ruleset
set_winapi_family_desktop.h
target_delayload.cmake
uwp_stubs.h
vcpkg-configuration.json Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
vcpkg.json Enable VCPKG in CI build (#23426) 2025-02-05 10:58:53 -08:00
wcos_rules_override.cmake
winml.cmake Fix a tiny problem in winml.cmake (#23173) 2024-12-20 11:48:43 -08:00
winml_cppwinrt.cmake
winml_sdk_helpers.cmake
winml_unittests.cmake