onnxruntime/docs/performance/tune-performance
Maximilian Müller f20db76f54
Add device tensor documentation for GPU execution providers (#20837)
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT 
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-06-12 09:11:25 -07:00
..
index.md [Docs] Update performance sections (#15071) 2023-03-17 15:39:22 -07:00
iobinding.md Add device tensor documentation for GPU execution providers (#20837) 2024-06-12 09:11:25 -07:00
logging_tracing.md Adding cookie consent (#19635) 2024-02-26 11:15:05 -08:00
memory.md Added docs for ONNX 1.17 covering logging, tracing, and QNN EP Profiling (#19428) 2024-02-07 10:47:15 -08:00
profiling-tools.md Adding cookie consent (#19635) 2024-02-26 11:15:05 -08:00
threading.md Added docs for ONNX 1.17 covering logging, tracing, and QNN EP Profiling (#19428) 2024-02-07 10:47:15 -08:00
troubleshooting.md Added docs for ONNX 1.17 covering logging, tracing, and QNN EP Profiling (#19428) 2024-02-07 10:47:15 -08:00