onnxruntime/docs/execution-providers
Maximilian Müller f20db76f54
Add device tensor documentation for GPU execution providers (#20837)
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT 
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-06-12 09:11:25 -07:00
..
community-maintained [CANN] Update the doc of CANN EP (#20138) 2024-04-01 21:36:05 -07:00
add-execution-provider.md [website] Fix sidebar ordering (#17620) 2023-09-20 14:11:50 -07:00
Azure-ExecutionProvider.md [website] Fix sidebar ordering (#17620) 2023-09-20 14:11:50 -07:00
CoreML-ExecutionProvider.md Update CoreML EP docs (#19844) 2024-04-04 21:54:09 -07:00
CUDA-ExecutionProvider.md Add device tensor documentation for GPU execution providers (#20837) 2024-06-12 09:11:25 -07:00
DirectML-ExecutionProvider.md Add device tensor documentation for GPU execution providers (#20837) 2024-06-12 09:11:25 -07:00
index.md Document AzureEP 1.16 (#17289) 2023-08-30 12:48:36 -07:00
MIGraphX-ExecutionProvider.md [website] Fix sidebar ordering (#17620) 2023-09-20 14:11:50 -07:00
NNAPI-ExecutionProvider.md Update NNAPI-ExecutionProvider.md supported ops (#16841) 2023-12-20 09:22:05 +10:00
oneDNN-ExecutionProvider.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
OpenVINO-ExecutionProvider.md Ort openvino npu 1.18.0 doc (#20707) 2024-05-19 23:10:24 -07:00
QNN-ExecutionProvider.md [QNN EP] update docs (#20705) 2024-05-17 11:19:41 -07:00
ROCm-ExecutionProvider.md [Doc] Update latest ROCm version (#19665) 2024-02-29 15:07:22 +08:00
TensorRT-ExecutionProvider.md [TensorRT Docs] Extending engine embedding docs (#20848) 2024-06-03 13:31:13 -07:00
Vitis-AI-ExecutionProvider.md Update Vitis-AI-ExecutionProvider.md (#18706) 2023-12-07 14:49:33 -08:00
Xnnpack-ExecutionProvider.md Fix XNNPACK code snippet rendering (#19685) 2024-02-27 19:47:29 -08:00