onnxruntime/include/onnxruntime/core
Chi Lo fa4cbcd36b
[TensorRT EP] Add new provider option to exclude nodes from running on TRT (#22681)
Add new provider option `trt_op_types_to_exclude`:
- User can provide op type list to be excluded from running on TRT
- e.g. `trt_op_types_to_exclude="MaxPool"`

There is a known performance issue with the DDS ops (NonMaxSuppression,
NonZero and RoiAlign) from TRT versions 10.0 to 10.7. TRT EP excludes
DDS ops from running on TRT by default, user can override default value
with empty string to include all ops.
2024-11-13 11:34:43 -08:00
..
common Remove nsync (#20413) 2024-10-21 15:32:14 -07:00
eager Fix typos - 1st Wave (#21278) 2024-07-11 13:35:08 +08:00
framework Revert "enable serialize prepacked weights into data file (#22256)" (#22788) 2024-11-11 09:59:05 -08:00
graph Revert "enable serialize prepacked weights into data file (#22256)" (#22788) 2024-11-11 09:59:05 -08:00
optimizer Utilize ext data location to reduce qd matmul memory usage (#21451) 2024-07-30 15:22:46 -07:00
platform Remove nsync (#20413) 2024-10-21 15:32:14 -07:00
providers [TensorRT EP] Add new provider option to exclude nodes from running on TRT (#22681) 2024-11-13 11:34:43 -08:00
session Revert "enable serialize prepacked weights into data file (#22256)" (#22788) 2024-11-11 09:59:05 -08:00