mirror of
https://github.com/saymrwulf/onnxruntime.git
synced 2026-06-29 03:30:52 +00:00
86870114eb
### Description Refactor compute plan profiling Support cache coreml model to speed up session initialization. this is only support by user provided entry and user responsible to manage the cache With the cache, session initialization time can be reduced by 50% or more: |model| before| after| |--|--|--| |yolo11.onnx| 0.6s|0.1s| |yolo11-fp16.onnx|1.8s|0.1s| ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> --------- Co-authored-by: wejoncy <wejoncy@.com> Co-authored-by: Scott McKay <skottmckay@gmail.com> |
||
|---|---|---|
| .. | ||
| azure | ||
| cann | ||
| coreml | ||
| cpu | ||
| cuda | ||
| dnnl | ||
| internal_testing | ||
| migraphx | ||
| nnapi | ||
| qnn | ||
| rknpu | ||
| tensorrt | ||
| xnnpack | ||
| base_tester.cc | ||
| base_tester.h | ||
| checkers.cc | ||
| checkers.h | ||
| compare_provider_test_utils.cc | ||
| compare_provider_test_utils.h | ||
| get_execution_providers_test.cc | ||
| kernel_compute_test_utils.cc | ||
| kernel_compute_test_utils.h | ||
| memcpy_test.cc | ||
| model_tester.h | ||
| op_kernel_type_control_test.cc | ||
| op_tester.cc | ||
| op_tester.h | ||
| partitioning_utils_test.cc | ||
| provider_test_utils.h | ||
| run_options_config_keys.h | ||
| tester_types.h | ||