onnxruntime/onnxruntime/test/testdata/multi_stream_models
cao lei 6b73ab3e3e
Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream (#19515)
### Description
<!-- Describe your changes. -->
Introduce reused_buffer_index_per_stream in allocation planner which
will be reset after computing the reuse buffer for each stream. So if a
NodeArg is an input of several Ops across different streams and reuses
other NodeArg, the reused NodeArg won't be involved when computing the
second stream's reuse plan.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This is to fix https://github.com/microsoft/onnxruntime/issues/19480,
which is a crash for the scenario mentioned above.

---------

Co-authored-by: Lei Cao <leca@microsoft.com>
2024-02-22 10:19:08 -08:00
..
3_gpu_streams.json remove unnecessary waitOnEPStep when current node and the consumer node are in the same stream (#14173) 2023-01-20 07:35:15 -08:00
conv_add_relu.onnx
conv_add_relu_single_stream.json
conv_add_relu_single_stream_mismatch_device.json
conv_add_relu_single_stream_missing_node.json
cpu_if.onnx Sync between parent node and subgraph (#15757) 2023-05-11 09:28:04 -07:00
issue_19480.onnx Introduce reused_buffer_index_per_stream in allocation planner which will be reset after computing the reuse buffer for each stream (#19515) 2024-02-22 10:19:08 -08:00
memcpyToHost_same_stream_with_transpose.json Make MemcpyToHost to a separate stream for performance gain (#14487) 2023-02-23 14:52:01 -08:00
multi_stream_double_stream.json
multi_stream_single_stream.json
simplified_ssd.onnx
simplified_ssd_cpu.json