saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-05-18 21:21:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Remove advice to use IO Binding for this scenario (#11006)

Browse source
This commit is contained in:
Nat Kershaw (MSFT) 2022-03-30 10:23:50 -07:00 committed by GitHub
parent c37d2728bf
commit 998bf0fdb6
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
onnxruntime/python/tools/transformers/notebooks/PyTorch_Bert-Squad_OnnxRuntime_GPU.ipynb
View file

@ -416,7 +416,6 @@
"latency = []\n",
"for i in range(total_samples):\n",
" data = dataset[i]\n",
" # TODO: use IO Binding (see https://www.onnxruntime.ai/python/api_summary.html) to improve performance.\n",
" ort_inputs = {\n",
" 'input_ids': data[0].cpu().reshape(1, max_seq_length).numpy(),\n",
" 'input_mask': data[1].cpu().reshape(1, max_seq_length).numpy(),\n",