onnxruntime/images
Maximilian Müller f20db76f54
Add device tensor documentation for GPU execution providers (#20837)
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT 
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-06-12 09:11:25 -07:00
..
logos [Website] Add Deezer quote/logo (#17360) 2023-08-31 12:43:38 -07:00
svg
agility.png
android_image_classification_screenshot_1.png
android_image_classification_screenshot_2.jpg
android_image_classification_screenshot_3.png
android_image_classification_screenshot_4.png
android_image_classification_screenshot_5.png
android_image_classification_screenshot_6.png
API-platform-support.png
azureml-deployment.png Add AzureML tutorial (#11340) 2022-06-03 16:43:46 -07:00
bert-excel.gif Update Excel BERT ORT Web tutorial (#13887) 2022-12-07 18:33:26 -06:00
bing-logo.svg
coffee.png Add phi3 v tutorial (#20873) 2024-05-30 17:48:26 -07:00
combine-ai-extensions-img.png Added initial ORT Extensions docs for onnxruntime website (#16723) 2023-09-01 15:56:33 -07:00
continuous-community-innovation.png
custom_op_wrapper.png [GH Pages] Update custom op documentation (#14623) 2023-02-10 16:48:24 -08:00
customvision-logo.jpg
demo.jpg
dog.jpeg
ios_screenshot_objdetect.jpg
iOS_speaker_identification_app.png Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_infer_screen.jpg Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_training_complete_screen.jpg Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_training_progress_screen.jpg Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_training_screen.jpg Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_xcode_new_app_screen.png Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_xcode_new_project_screen.png Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
iOS_speaker_identification_xcode_project_nav_screen.png Add iOS On Device Training Tutorial with ONNX Runtime (#17146) 2023-08-17 00:58:22 -07:00
latents-noise-example.png Revert "Revert "Merge branch 'gh-pages' of https://github.com/microsoft/onnxruntime into gh-pages"" 2023-03-10 17:02:38 -08:00
layered-architecture.png
market.png Add phi3 v tutorial (#20873) 2024-05-30 17:48:26 -07:00
Micorsoft-Azure-Logo.png
microsoft-azure.png
mkl-dnn_node.png
mkl-dnn_subgraph.png
mnist-screenshot.png
mnist_optimization.png
mnist_optimization_with_nnapi.png
mobile-superres-after-model-io.png Mobile superres tutorial (#14635) 2023-02-15 15:38:25 -08:00
mobile-superres-after-model.png Mobile superres tutorial (#14635) 2023-02-15 15:38:25 -08:00
mobile-superres-before-model-io.png Mobile superres tutorial (#14635) 2023-02-15 15:38:25 -08:00
mobile-superres-before-model.png Mobile superres tutorial (#14635) 2023-02-15 15:38:25 -08:00
mobile-superres-cat.png Mobile superres tutorial (#14635) 2023-02-15 15:38:25 -08:00
mobile.png Refresh mobile get started (#14447) 2023-01-31 11:30:27 -08:00
model-with-dynamic-inputs-fixed.png Add documentation for ORT Mobile helpers (#10890) 2022-04-05 17:05:43 -07:00
model-with-dynamic-inputs.png Add documentation for ORT Mobile helpers (#10890) 2022-04-05 17:05:43 -07:00
model-with-symbolic-input-dim-fixed.png Add documentation for ORT Mobile helpers (#10890) 2022-04-05 17:05:43 -07:00
model-with-symbolic-input-dim.png Add documentation for ORT Mobile helpers (#10890) 2022-04-05 17:05:43 -07:00
nnapi_aware_ort_format_model.png
on-device-training-android-studio-project-name.png Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-android-studio-setup.png Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-android-studio-toolchain.png Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-application-landing-page.jpg Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-application-prediction-cow.jpg Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-application-prediction-tom.jpg Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-lib-include.png Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
on-device-training-project-assets.png Add On Device Training Tutorial with ONNX Runtime (#16167) 2023-06-15 16:01:26 -07:00
ONNX-Icon.png
ONNX-Runtime-logo.png
ONNX-Runtime-logo.svg
ONNX_Runtime_EP1.png
ONNX_Runtime_EP2.png
ONNX_Runtime_EP3.png
ONNXRuntime-Favicon.png
optimization-acceleration.png
ort-bar-chart.PNG
ORT-Edge-Azure.png
ORT-Mobile.png
ort-nvidia.jpg
ort-web-demo.gif
out.jpg
performance.png
person-with-bicycle-and-bounding-boxes.png Add pose detection tutorial (#19580) 2024-02-26 16:52:00 -08:00
person-with-pose.png Add pose detection tutorial (#19580) 2024-02-26 16:52:00 -08:00
pipeline_pci_processing.png Add device tensor documentation for GPU execution providers (#20837) 2024-06-12 09:11:25 -07:00
pose-thumbnail.png Add pose detection tutorial (#19580) 2024-02-26 16:52:00 -08:00
pytorch-builtin.png
pytorch-on-the-edge-puppies.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
pytorch-on-the-edge-speechrec.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
pytorch-on-the-edge-textgen.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
pytorch-on-the-edge-training.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
pytorch-on-the-edge-with-ort.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
pytorch-on-the-edge.png Add PyTorch edge blog (#17929) 2023-10-12 19:41:43 -07:00
qa-nlp.png Add AzureML tutorial (#11340) 2022-06-03 16:43:46 -07:00
QDQ_Format.png
qnn_ep_quant_workflow.png [Gh pages] Update QNN EP documentation (quantization/python APIs) (#19435) 2024-02-06 12:36:15 -08:00
rasp-pi-can.png Update the IoT Docs home page and add Raspberry Pi Tutorial (#14096) 2023-01-05 18:33:30 -06:00
rbpi-camera.jpg Update the IoT Docs home page and add Raspberry Pi Tutorial (#14096) 2023-01-05 18:33:30 -06:00
sample-output-stablediff.png Revert "Revert "Merge branch 'gh-pages' of https://github.com/microsoft/onnxruntime into gh-pages"" 2023-03-10 17:02:38 -08:00
skl-ort.png
stablediff-example-image.png Revert "Revert "Merge branch 'gh-pages' of https://github.com/microsoft/onnxruntime into gh-pages"" 2023-03-10 17:02:38 -08:00
sushi.png Add phi3 v tutorial (#20873) 2024-05-30 17:48:26 -07:00
table.png Add phi3 v tutorial (#20873) 2024-05-30 17:48:26 -07:00
terminal-output-rasp-pi.png Update the IoT Docs home page and add Raspberry Pi Tutorial (#14096) 2023-01-05 18:33:30 -06:00
top-banner-background.jpg
tutorial-superres-og-image.png Add preview image for super res tutorial and update title (#15004) 2023-03-11 20:15:35 -08:00
twitter-icon.png
video-bing-semantic-precise.jpg
video-check-out-schedule.png
video-model-inference-cloud-to-client.jpg
video-research-prod.png
video-scalable-ml.jpg
vncviewerrasppi.png Update the IoT Docs home page and add Raspberry Pi Tutorial (#14096) 2023-01-05 18:33:30 -06:00
windowsdevkit2023.png [website] Updates for Windows Dev Kit 2023 (#13405) 2022-10-24 09:12:46 -07:00
wolves-with-bounding-boxes.png Add pose detection tutorial (#19580) 2024-02-26 16:52:00 -08:00
word-logo.png
youtube-convert.png Add social links to nav header and update video resources (#13784) 2022-11-30 14:46:10 -08:00
youtube-cpp.png Add social links to nav header and update video resources (#13784) 2022-11-30 14:46:10 -08:00
youtube-logo.png
youtube-release.png Add social links to nav header and update video resources (#13784) 2022-11-30 14:46:10 -08:00
youtube-ue5.png Add social links to nav header and update video resources (#13784) 2022-11-30 14:46:10 -08:00