saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-28 20:11:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

[TensorRT EP] update gen_trt_engine_wrapper_onnx_model.py script (#22184)

Browse source 
update script which was using deprecated num_bindings to num_io_tensors
tested on an engine dumped by trtexec and loaded the engine using
onnxruntime-gpu 1.19.2 python package.
This commit is contained in:
George Wu 2024-09-24 14:34:05 -07:00 committed by GitHub
parent 6cc06ad069
commit 7727b4b909
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
onnxruntime/python/tools/tensorrt/gen_trt_engine_wrapper_onnx_model.py
View file

@ -38,7 +38,7 @@ class TensorRTEngineWrapperCreator:
# Deserialize an TRT engine
runtime = trt.Runtime(logger)
engine = runtime.deserialize_cuda_engine(engine_buffer)
num_bindings = engine.num_bindings
num_bindings = engine.num_io_tensors
input_tensors = []
output_tensors = []