Chi Lo 4e3cff60fd CUDA graph support for TRT EP (#16081) ... CUDA EP already supports [CUDA graph](https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#cuda-graphs), also we observed some models can benefit from using CUDA graph with `trtexec`. Therefore, this PR enables the CUDA graph support for TRT EP. The implementation is based on https://github.com/microsoft/onnxruntime/pull/9978 with the same [constraints](https://github.com/microsoft/onnxruntime/pull/9978) as below: - Models with control-flow ops (i.e. If, Loop and Scan ops) are not supported. - Usage of CUDA Graphs is limited to models where-in all the model ops (graph nodes) can be partitioned to the TRT EP. - The input/output types of models need to be tensors. - Shapes of inputs/outputs cannot change across inference calls. - IObinding is required.		2023-06-21 09:36:45 -07:00
..
acl
armnn
cann	[CANN] Multi-stream execution support for CANN EP. (#14058)	2023-03-29 11:57:22 -07:00
coreml
cpu
cuda	[ROCm] add early stop to tunable profile progress (#15716)	2023-06-01 10:18:25 +08:00
dml	Run clang-format in CI (#15524)	2023-04-18 09:26:58 -07:00
dnnl	[oneDNN] Improved thread handling (#13618)	2023-01-31 14:37:13 -08:00
nnapi	remove disable_cpu_soft temporarily	2023-03-15 13:23:56 +08:00
openvino	Openvino ep ort 5.0 (#15626)	2023-04-25 20:59:42 -07:00
rknpu
tensorrt	CUDA graph support for TRT EP (#16081)	2023-06-21 09:36:45 -07:00
tvm	[TVM EP] code refactor (#10655)	2022-03-16 13:55:04 +01:00
winml
providers.h