saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-28 20:11:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update TensorRT-ExecutionProvider.md (#6161)

Browse source
This commit is contained in:
Jay Rodge 2020-12-17 19:10:40 -06:00 committed by GitHub
parent 32c67c2944
commit dec703b62d
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

8
docs/execution_providers/TensorRT-ExecutionProvider.md
View file

@ -1,11 +1,11 @@
# TensortRT Execution Provider
# TensorRT Execution Provider
The TensorRT execution provider in the ONNX Runtime makes use of NVIDIA's [TensortRT](https://developer.nvidia.com/tensorrt) Deep Learning inferencing engine to accelerate ONNX model in their family of GPUs. Microsoft and NVIDIA worked closely to integrate the TensorRT execution provider with ONNX Runtime.
The TensorRT execution provider in the ONNX Runtime makes use of NVIDIA's [TensorRT](https://developer.nvidia.com/tensorrt) Deep Learning inferencing engine to accelerate ONNX model in their family of GPUs. Microsoft and NVIDIA worked closely to integrate the TensorRT execution provider with ONNX Runtime.
With the TensorRT execution provider, the ONNX Runtime delivers better inferencing performance on the same hardware compared to generic GPU acceleration.
## Build
For build instructions, please see the [BUILD page](../../BUILD.md#tensorrt).
For build instructions, please see the [BUILD page](../../BUILD.md#TensorRT).
The TensorRT execution provider for ONNX Runtime is built and tested with TensorRT 7.1.3.4.
@ -111,4 +111,4 @@ underlying hardware changes. Engine files are not portable across devices.
export ORT_TENSORRT_CACHE_PATH="/path/to/cache"
### Dump out subgraphs to run on TensorRT
export ORT_TENSORRT_DUMP_SUBGRAPHS = 1
export ORT_TENSORRT_DUMP_SUBGRAPHS = 1