Commit graph

182 commits

Author SHA1 Message Date
Ted Themistokleous
39c4083ef4
[MIGraphX EP] Update MIGraphX support matrix (#23480)
### Description
Update support Matrix for MIGraphX EP and add related info about
prebuilt wheels and python support.


### Motivation and Context
Updating the latest info and pointing uses to the wheel we support with
each corresponding ROCm release.

---------

Co-authored-by: Ted Themistokleous <tedthemistokleous@amd.com>
2025-01-24 14:01:49 -08:00
Xinpeng Dou
c67816d65b
Fix the bug of C++ sample in CANN EP file (#23186)
### Description
Fix the bug of C++ sample in CANN EP file
2024-12-28 22:13:47 -08:00
wejoncy
af2f2d517c
[DOC] update coreml new opretors and flags (#22958)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: Scott McKay <skottmckay@gmail.com>
2024-12-24 10:13:39 +08:00
Xinpeng Dou
7ad9caa501
[CANN]: Update the doc of CANN EP (#23087)
### Description
This PR update docs of Ascend CANN execution provider.
2024-12-17 19:43:15 -08:00
Maanav Dalal
77f2278f9a
Fixed all accessibility colors. Again. (#23055)
Should address the last 300+ accessibility color issues.
2024-12-10 21:06:58 -06:00
jingyanwangms
a9d566c711
Update TensorRT Documentation (#22829)
### Description
Update TensorRT Documentation



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-11-13 21:42:28 -08:00
Sophie Schoenmeyer
b57e2e121d
Update EP version info after ORT 1.20 (#22715)
### Description
<!-- Describe your changes. -->
Included new version info for CUDA, TensorRT, and DirectML execution
providers following ORT 1.20 release publish.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-11-04 13:25:42 -08:00
Hector Li
d9dcc8ebe3
add instruction to enable new Ops for QNN EP (#22647)
### Description
add instruction to enable new Ops for QNN EP
2024-10-31 15:50:30 -07:00
Nat Kershaw (MSFT)
381b610ccc
Onnxruntime nightly install (#22529) 2024-10-25 16:43:26 -07:00
Michael Tyler
7faa4b1eb4
Update documentation for Arm Compute Library (#22232)
### Description
This PR updates the documentation regarding the ACL execution provider
to reflect the changes made in #22032.
It also updates various references to Arm's trademarks in accordance
with the Arm trademark use guidelines.



### Motivation and Context
Ensures documentation is accurate following recent changes.

---------

Signed-off-by: Michael Tyler <michael.tyler@arm.com>
2024-09-30 18:56:27 -07:00
Hector Li
b6ff0cc5fd
Qnn weight sharing doc (#22109)
### Description
QNN EP weight sharing docs
2024-09-25 13:24:36 -07:00
Tianlei Wu
bc1bce956a
[Doc] Update GPU package installation (#22204)
### Description
* Add CUDA/CuDNN requirements for 1.19.x
* Update installation guide for cuda 11 package and nightly.
* Remove a sentence for ROCm: `Alternatively, each major ORT release has
a corresponding C/C++ ROCm package, found
[here](https://github.com/microsoft/onnxruntime/releases/).` since
onnxruntime_rocm package is not available in recent releases.

### Motivation and Context
Doc is not up to date.
2024-09-24 13:57:20 -07:00
Yifan Li
85c3f0fe0b
[TensorRT EP] [documentation] Set cuda 12 as default for ORT 1.19 (#21758) 2024-09-24 10:21:29 -07:00
Hector Li
9b710421f9
EP context cache feature design (#22142)
### Description
EP context cache feature design
2024-09-24 09:22:05 -07:00
Abdullah Shafin
b91a3aeb5c
Fix typo in docs: TensorRT-ExecutionProvider.md (#22128)
### Description
While reading the docs, I came across a typo. This PR proposes to fix it.

### Motivation and Context
Improve documentation.
2024-09-18 14:08:31 -07:00
Scott McKay
fb43a3387d
Update CoreML supported ops lists (#21627)
### Description
<!-- Describe your changes. -->
Update CoreML ops lists with recent additions.


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: Edward Chen <18449977+edgchen1@users.noreply.github.com>
2024-09-06 09:29:18 +10:00
Preetha Veeramalai
c4025042ae
Update documentation for ovep rel-5.4 (#21909)
### Description
Contains doc updates on latest OVEP 5.4 release.
2024-09-04 11:17:36 -07:00
Sophie Schoenmeyer
16905ccdc5
Update DirectML-ExecutionProvider.md (#21407)
Update DML EP docs w/ correct DML + ONNX opset version

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-07-18 10:18:52 -07:00
Tianlei Wu
31f7cfb09d
[Doc] cuda and cudnn requirements for 1.18.1 gpu packages (#21377)
### Description
Add CUDA and cuDNN requirements for 1.18.1 GPU package.

### Motivation and Context
https://github.com/microsoft/onnxruntime/issues/21354
https://github.com/microsoft/onnxruntime/issues/21173
2024-07-17 10:44:21 -07:00
Maximilian Müller
f20db76f54
Add device tensor documentation for GPU execution providers (#20837)
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT 
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-06-12 09:11:25 -07:00
Maximilian Müller
7d89749e0c
[TensorRT Docs] Extending engine embedding docs (#20848)
Adding to the docs a link on how to embed an externally compiled engine
and also mention that in case of an embedded engine the builder resource
is not needed.
2024-06-03 13:31:13 -07:00
Yifan Li
73df4e5337
[TensorRT EP] Update doc (#20857)
### Description
<!-- Describe your changes. -->
* Reorganize table and group items by scenarios
* Add `trt_engine_hw_compatible` doc
* Update jetson instruction with TensorRT 10 info

### UI comparison
After:
https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations
Before:
https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations
2024-05-29 21:51:35 -07:00
Chi Lo
e3e4f215f1
[TensorRT EP] TRT EP cache docs (#20785)
Add a section for how to use three major TRT EP caches: TRT timing
cache, TRT engine cache and Embedded engine model /EPContext model.
Some materials are from my GTC slides.
2024-05-24 18:53:59 -07:00
Jian Chen
51caf9851e
Update CUDA-ExecutionProvider.md (#20795)
update cudnn to 8.9.2.26 (Linux)<br/>8.9.2.26 (Windows)

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-23 14:23:56 -07:00
Jian Chen
08cae80a6b
Update CUDA-ExecutionProvider.md (#20767) 2024-05-22 10:15:19 -07:00
sfatimar
3909f23ee6
Ort openvino npu 1.18.0 doc (#20707)
### Description
-These changes reflect the latest changes we have made to enable NPU
-Export OpenVINO Blob to ONNX Operator
-Enable QDQ Optimizations Passes
- Separate Device/Precision



### Motivation and Context
These changes reflect the latest changes we have made to enable NPU. 
These changes reflect the latest changes we have made to enable rel-1.18
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
2024-05-19 23:10:24 -07:00
George Wu
ca6b0f8cb2
[QNN EP] update docs (#20705)
update docs with for version 1.18.0
2024-05-17 11:19:41 -07:00
Hector Li
564d725031
Add error handling session in QNN doc (#20579)
Add error handling session in QNN doc
2024-05-07 10:44:00 -07:00
Yifan Li
f131eb9993
[TensorRT EP] Update doc to TRT10 (#20580)
### Description
<!-- Describe your changes. -->
* Update TRT version to 10.0


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-07 10:05:46 -07:00
Sophie Schoenmeyer
ff5c5c5cdc
Update CUDA-ExecutionProvider.md to add TOC (#20443)
### Description
CUDA-ExecutionProvider.md table of contents previously not showing up
correctly b/c of spacing issue.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-23 14:31:49 -07:00
Yifan Li
55edff104f
[TensorRT EP] Update instruction of user_compute_stream (#20343)
### Description
<!-- Describe your changes. -->
Update instruction and add sample code

### Preview the change:

https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#execution-provider-options

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-17 13:45:06 -07:00
Scott McKay
e0a6a9640b
Update CoreML EP docs (#19844)
### Description
Add new flags and MLProgram supported ops.

### Motivation and Context
Update docs
2024-04-04 21:54:09 -07:00
wangshuai09
216231d197
[CANN] Update the doc of CANN EP (#20138)
This PR update docs of Ascend CANN excution provider doc for #20075 

### Changes
1. Add new option
`dump_om_model`: Whether to dump the OM(Offlined Model for Aasend Npu)
to disk

---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-04-01 21:36:05 -07:00
Tianlei Wu
a62200665e
[Doc] Update CUDA and cuDNN installation (#20035)
(1) Add CUDA and cuDNN installation section to ORT installation.
(2) For build, TRT EP refers to CUDA EP for CUDA/cuDNN installation to avoid duplication.
(3) Add comments about CUDA/cuDNN compatiblility
2024-03-22 16:38:08 -07:00
Jeff Mendenhall
180cb20298
Update QNN-ExecutionProvider.md (#20017)
update to link to Qualcomm SDK docs

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-03-21 16:30:16 -07:00
Hector Li
6f9c0a2fe7
Add option to enable FP16 precision for QNN EP (#19971)
add option to enable FP16 precision for QNN EP
2024-03-18 15:58:17 -07:00
Yulong Wang
cdf838a194
[doc] fix invalid link in OpenVINO EP doc (#19855)
### Description
fix invalid link in OpenVINO EP doc
2024-03-12 12:13:49 -07:00
sfatimar
780fb2f53f
Update OpenVINO-ExecutionProvider.md (#19794)
### Description
Documentation Update for Release 1.17.1 



### Motivation and Context
This change is required for Documentation Update for Release 1.17.1
Packages.
Alignment with OpenVINO 2023.3.
2024-03-08 10:41:23 -08:00
Ye Wang
705e0e79db
update docs to include multi-cudagraph support (#19818)
### Description
<!-- Describe your changes. -->

docs for https://github.com/microsoft/onnxruntime/pull/19636

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-03-07 12:51:49 -08:00
Tianlei Wu
b6a1108c80
[Doc] CUDA build options (#19678) 2024-02-29 15:31:47 -08:00
PeixuanZuo
4b9a7e270e
[Doc] Update latest ROCm version (#19665)
Update latest ROCm version
2024-02-29 15:07:22 +08:00
Nat Kershaw (MSFT)
401a08884e
Fix XNNPACK code snippet rendering (#19685) 2024-02-27 19:47:29 -08:00
kailums
4f39cf083e
[doc] add config options for rocm ep (#19643)
Add config options for ROCM ep in docs.

### Motivation and Context
Since we don't have any config options described in rocm ep docs, so i
add some config descriptions according to cuda ep.
2024-02-26 20:46:55 -08:00
Ye Wang
69ca776a80
Fix TRT doc (#19658)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

https://github.com/microsoft/onnxruntime/issues/19641
2024-02-26 18:17:17 -08:00
Tianlei Wu
154a0beaba
[Doc] Add use_tf32 cuda provider option (#19548)
### Description
Add document of use_tf32 cuda provider option.
2024-02-20 13:58:39 -08:00
Yifan Li
44b7002e3b
[TensorRT EP] Add missing doc for trt_timing_cache_path (#19478)
### Description
<!-- Describe your changes. -->
The usage of `trt_timing_cache_path` is missing in TRTEP doc.

To review the change:
https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-02-13 12:37:27 -08:00
ivberg
7e64928b06
Added docs for ONNX 1.17 covering logging, tracing, and QNN EP Profiling (#19428)
### Description
Added docs for ONNX 1.17 covering logging, tracing, and QNN EP Profiling

### Motivation and Context
- ONNX Logging has not been documented
- ONNX Tracing with Windows has barely been documented
- ONNX 1.17 has new tracing and QNN EP Profiling

PRs: #16259,  #18201, #18882, #19397
2024-02-07 10:47:15 -08:00
Adrian Lizarraga
519fa389a9
[Gh pages] Update QNN EP documentation (quantization/python APIs) (#19435)
### Description
Preview:
https://adrianlizarraga.github.io/onnxruntime/docs/execution-providers/QNN-ExecutionProvider.html#running-a-model-with-qnn-eps-htp-backend-python

- Adds QNN EP documentation:
  - Create a quantized QDQ model using python quantization utilities
  - Run quantized QDQ model on Windows ARM64 using python ORT APIs.
- Updates QNN EP provider options
- Adds list of supported ONNX operators
- Provides instructions for using the new arm64 python wheel


### Motivation and Context
The aim is to make it easier for users to try QNN EP.
2024-02-06 12:36:15 -08:00
Tianlei Wu
fde74cbb00
[Doc] update onnxruntime-gpu pip installation for cuda 12 (#19404)
### Description
Update doc for cuda 12 GPU package pip installation
2024-02-05 11:00:11 -08:00
Yifan Li
c4bcf6c80d
[TensorRT EP] Add description for new option trt_engine_cache_prefix (#19362)
### Description
Add description for new option trt_engine_cache_prefix


### Preview

https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations
2024-02-02 23:37:34 -08:00