onnxruntime/onnxruntime/core
kailums 6f566562ce
support user_compute_stream for rocm ep (#19619)
### Description
<!-- Describe your changes. -->
According to the pr #19229 supporting cuda EP use external compute
stream, we add support for rocm EP.

And when we testing this feature with torch, we found torch use stream 0
for the default stream, and `torch.cuda.current_stream()` returns `0`
for current stream, but ort treat `0` or `nullptr` as invalid, and reset
has_user_compute_stream to false. 

Will remove has_user_compute_stream option in the future.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
The motivation for this pr is that we want to use torch.cuda.graph to
capture ort running kernel, which requires torch and ort are running in
the same stream, so we use this API to set ort's working stream.
2024-02-27 11:31:03 +08:00
..
codegen Replace some ORT_ENFORCE with ORT_THROW_IF_ERROR (#18812) 2023-12-14 10:14:22 -08:00
common [aarch64] Add Sbgemm kernel to accelerate fp32 tensor matmul with bfloat16 (#17031) 2024-01-22 14:43:06 -08:00
dll
dlpack
eager
flatbuffers Introduce a Nominal Checkpoint for On-Device Training (#19232) 2024-01-30 22:11:25 -08:00
framework Enable user to set QNN HTP performance mode for every session run (#19521) 2024-02-22 17:04:59 -08:00
graph Whisper Timestamps and Temperature (#19509) 2024-02-16 15:21:43 -08:00
language_interop_ops
mickey Adding unit test for sm80 prepack (#18514) 2023-11-28 10:01:09 -08:00
mlas [MLAS AArch64] SQNBitGemm optimization (#19272) 2024-01-30 14:29:12 -08:00
optimizer Disable gemm activation for non-float data types (#19612) 2024-02-23 18:20:22 -08:00
platform fix memory mapping on Windows (#19623) 2024-02-25 08:50:45 -08:00
providers support user_compute_stream for rocm ep (#19619) 2024-02-27 11:31:03 +08:00
quantization
session [DML EP] Enable DML Graph Serialization (#19505) 2024-02-26 11:35:13 -08:00
util Perf improvement for Intel MTL CPUs (#19524) 2024-02-14 18:35:56 -08:00