Commit graph

2 commits

Author SHA1 Message Date
Tianlei Wu
736ed7aeb7
[Doc] Fix links in Device Tensor Doc (#21039) 2024-06-13 15:25:44 -07:00
Maximilian Müller
f20db76f54
Add device tensor documentation for GPU execution providers (#20837)
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT 
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-06-12 09:11:25 -07:00