saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-29 20:14:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

[TensorRT EP] Add missing doc for trt_timing_cache_path (#19478)

Browse source 
### Description
<!-- Describe your changes. -->
The usage of `trt_timing_cache_path` is missing in TRTEP doc.

To review the change:
https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This commit is contained in:
Yifan Li 2024-02-13 12:37:27 -08:00 committed by GitHub
parent 3dc7242272
commit 44b7002e3b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 4 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
docs/execution-providers/TensorRT-ExecutionProvider.md
View file

@ -90,6 +90,7 @@ There are two ways to configure TensorRT settings, either by **TensorRT Executio
| trt_context_memory_sharing_enable | ORT_TENSORRT_CONTEXT_MEMORY_SHARING_ENABLE | bool |
| trt_layer_norm_fp32_fallback | ORT_TENSORRT_LAYER_NORM_FP32_FALLBACK | bool |
| trt_timing_cache_enable | ORT_TENSORRT_TIMING_CACHE_ENABLE | bool |
| trt_timing_cache_path | ORT_TENSORRT_TIMING_CACHE_PATH | string |
| trt_force_timing_cache | ORT_TENSORRT_FORCE_TIMING_CACHE_ENABLE | bool |
| trt_detailed_build_log | ORT_TENSORRT_DETAILED_BUILD_LOG_ENABLE | bool |
| trt_build_heuristics_enable | ORT_TENSORRT_BUILD_HEURISTICS_ENABLE | bool |
@ -179,6 +180,9 @@ TensorRT configurations can be set by execution provider options. It's useful wh
* `trt_timing_cache_enable`: Enable TensorRT timing cache.
* Check [Timing cache](#timing-cache) for details.
* `trt_timing_cache_path`: Specify path for TensorRT timing cache if `trt_timing_cache_enable` is `True`.
* Not specifying a `trt_timing_cache_path` will result in using the working directory
* `trt_force_timing_cache`: Force the TensorRT timing cache to be used even if device profile does not match.
* A perfect match is only the exact same GPU model as the on that produced the timing cache.