onnxruntime/onnxruntime/test/testdata/multi_stream_models/3_gpu_streams.json at 978c40d85310a1d9b8a6069be853bc3dbec44e18 - saymrwulf/onnxruntime - Forgejo: Beyond coding. We forge.

saymrwulf/onnxruntime

mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-25 19:48:11 +00:00

cao lei 22fdc31667

remove unnecessary waitOnEPStep when current node and the consumer node are in the same stream (#14173 )

### Description
Remove the unnecessary WaitOnEPStep if the current operator node and its
consumer are in the same stream while there are notifications filed in
the current node



### Motivation and Context
In the current code, the WaitOnEPStep will always be launched as long as
the notification is filed in the input node, no matter the current node
and the input node are in the same stream or not, which is not
necessary.
This PR is to remove the WaitOnEPStep for this case.

Co-authored-by: Lei Cao <leca@microsoft.com>

2023-01-20 07:35:15 -08:00

5 lines

104 B

JSON

Raw Blame History

 {
 "type":"DeviceBasedPartitioner",
 "streams":[["node1"],["node2"],["node3"]],
 "devices":["1","1","1"]
 }