saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-20 19:12:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update TensorRT EP docs for ORT 1.11 (#11055)

Browse source
This commit is contained in:
George Wu 2022-03-30 14:07:06 -07:00 committed by GitHub
parent dad658f53c
commit d699805e24
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 7 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
docs/build/eps.md vendored
View file

@ -99,7 +99,7 @@ See more information on the TensorRT Execution Provider [here](../execution-prov
* The path to the CUDA `bin` directory must be added to the PATH environment variable so that `nvcc` is found.
* The path to the cuDNN installation (path to folder that contains libcudnn.so) must be provided via the cuDNN_PATH environment variable, or `--cudnn_home` parameter.
* Install [TensorRT](https://developer.nvidia.com/tensorrt)
* The TensorRT execution provider for ONNX Runtime is built and tested with TensorRT 8.0.3.4.
* The TensorRT execution provider for ONNX Runtime is built and tested with TensorRT 8.2.3.0.
* To use different versions of TensorRT, prior to building, change the onnx-tensorrt submodule to a branch corresponding to the TensorRT version. e.g. To use TensorRT 7.2.x,
* cd cmake/external/onnx-tensorrt
* git remote update
@ -136,7 +136,7 @@ Dockerfile instructions are available [here](https://github.com/microsoft/onnxru
### Build Instructions
{: .no_toc }
These instructions are for JetPack SDK 4.6.
These instructions are for JetPack SDK 4.6.1.
1. Clone the ONNX Runtime repo on the Jetson host
@ -159,7 +159,7 @@ These instructions are for JetPack SDK 4.6.
export PATH="/usr/local/cuda/bin:${PATH}"
```
3. Install the ONNX Runtime build dependencies on the Jetpack 4.6 host:
3. Install the ONNX Runtime build dependencies on the Jetpack 4.6.1 host:
```bash
sudo apt install -y --no-install-recommends \
@ -169,7 +169,7 @@ These instructions are for JetPack SDK 4.6.
4. Cmake is needed to build ONNX Runtime. Because the minimum required version is 3.18,
it is necessary to build CMake from source. Download Unix/Linux sources from https://cmake.org/download/
and follow https://cmake.org/install/ to build from source. Version 3.21.1 has been tested on Jetson.
and follow https://cmake.org/install/ to build from source. Version 3.23.0 has been tested on Jetson.
5. Build the ONNX Runtime Python wheel:
@ -178,7 +178,7 @@ These instructions are for JetPack SDK 4.6.
--use_cuda --cuda_home /usr/local/cuda --cudnn_home /usr/lib/aarch64-linux-gnu
```
Note: You may optionally build with experimental TensorRT support.
Note: You may optionally build with TensorRT support.
```bash
./build.sh --config Release --update --build --parallel --build_wheel \

3
docs/execution-providers/TensorRT-ExecutionProvider.md
View file

@ -27,6 +27,7 @@ Pre-built packages and Docker images are available for Jetpack in the [Jetson Zo
|ONNX Runtime|TensorRT|CUDA|
|---|---|---|
|master|8.2|11.4|
|1.11|8.2|11.4|
|1.10|8.0|11.4|
|1.9|8.0|11.4|
|1.7-1.8|7.2|11.0.3|
@ -40,7 +41,7 @@ For more details on CUDA/cuDNN versions, please see [CUDA EP requirements](./CUD
See [Build instructions](../build/eps.md#tensorrt).
The TensorRT execution provider for ONNX Runtime is built and tested with TensorRT 8.0.3.4.
The TensorRT execution provider for ONNX Runtime is built and tested with TensorRT 8.2.3.0.
## Usage
### C/C++