Commit graph

793 commits

Author SHA1 Message Date
Yifan Li
73df4e5337
[TensorRT EP] Update doc (#20857)
### Description
<!-- Describe your changes. -->
* Reorganize table and group items by scenarios
* Add `trt_engine_hw_compatible` doc
* Update jetson instruction with TensorRT 10 info

### UI comparison
After:
https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations
Before:
https://onnxruntime.ai/docs/execution-providers/TensorRT-ExecutionProvider.html#configurations
2024-05-29 21:51:35 -07:00
Sophie Schoenmeyer
aa6097ad5b
Fix broken links (#20831)
### Description
Fix broken links referenced in issue #20790 

Llama2 blog link was updated to the correct location and ResNet sample
was removed entirely because it no longer exists anywhere in the AML
docs

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-28 13:27:09 -07:00
Chi Lo
e3e4f215f1
[TensorRT EP] TRT EP cache docs (#20785)
Add a section for how to use three major TRT EP caches: TRT timing
cache, TRT engine cache and Embedded engine model /EPContext model.
Some materials are from my GTC slides.
2024-05-24 18:53:59 -07:00
Parinita Rahi
3ae8137f74
small blog changes (#20818)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-24 15:02:38 -07:00
Jian Chen
51caf9851e
Update CUDA-ExecutionProvider.md (#20795)
update cudnn to 8.9.2.26 (Linux)<br/>8.9.2.26 (Windows)

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-23 14:23:56 -07:00
Ulrich Bönkemeyer
4b919fe2ac
Fix DirectML package name in genai/howto/install.md (#20771)
### Description
Fix package name 
from ```dotnet add package Microsoft.ML.OnnxRuntimeGenAI.*Cuda*
--prerelease``` to ```dotnet add package
Microsoft.ML.OnnxRuntimeGenAI.DirectML --prerelease``` in DirectML
section.

### Motivation and Context
Clearly confusing for beginners if not fixed (will break further processes)
2024-05-23 13:16:04 -07:00
Maanav Dalal
643a16a6bc
Updated meta tags for all pages on site. (#20772)
Should fix all SEO issues w/ posting blogs.
2024-05-22 12:16:07 -07:00
Jian Chen
08cae80a6b
Update CUDA-ExecutionProvider.md (#20767) 2024-05-22 10:15:19 -07:00
Maanav Dalal
23998c7b17
added meta tags to phi3 small medium blog post (#20760)
Updated blog post meta tags. Should work.
2024-05-21 17:39:25 -07:00
Sophie Schoenmeyer
7c820c45b1
Docs updates for ORT 1.18 (#20610)
### Description
Update compatibility/version info for ORT 1.18 release



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-21 17:27:56 -07:00
Yulong Wang
67ba2e5032
[doc] update docs for ORT web v1.19 (#20756)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-21 16:26:10 -07:00
Sophie Schoenmeyer
10973e7e24
Update Phi-3 small medium blog images (#20750)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-21 10:11:13 -07:00
Sophie Schoenmeyer
6f65797b98
Update +page.svx to fix some errors (#20749)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-21 10:00:00 -07:00
Parinita Rahi
59f1be1f74
blog for ONNX (#20747) 2024-05-21 09:09:05 -07:00
Nat Kershaw (MSFT)
58434d6ab2
Add Phi-3 medium (#20746) 2024-05-21 08:46:59 -07:00
Sophie Schoenmeyer
a5a36f11a7
Update Phi-3 on-device blog (#20744)
### Description
Updated blog link so it goes directly to the Hugging Face blog site



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-21 08:06:46 -07:00
Wanming Lin
944db3ed6c
[WebNN EP] Add WebNN doc (#20733)
- Add WebNN EP build instruction
- Update WebNN Chromium flag in tutorial
- Some minor updates
2024-05-21 00:17:31 -07:00
Nat Kershaw (MSFT)
35cd15e6a9
Generate() API updates (#20739)
Staged here: https://natke.github.io/onnxruntime/docs/genai/
2024-05-20 21:12:19 -07:00
Sophie Schoenmeyer
2fe196ea39
Add Phi-3 on device announcement (#20740)
### Description
Add announcement with link to Phi-3 On-Device blog on Hugging Face site

Staged here:
https://sophies927.github.io/onnxruntime/blogs/phi-3-on-device



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-20 14:28:54 -07:00
sfatimar
3909f23ee6
Ort openvino npu 1.18.0 doc (#20707)
### Description
-These changes reflect the latest changes we have made to enable NPU
-Export OpenVINO Blob to ONNX Operator
-Enable QDQ Optimizations Passes
- Separate Device/Precision



### Motivation and Context
These changes reflect the latest changes we have made to enable NPU. 
These changes reflect the latest changes we have made to enable rel-1.18
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: Preetha Veeramalai <preetha.veeramalai@intel.com>
2024-05-19 23:10:24 -07:00
kunal-vaishnavi
5fd617acc0
Update link to E2E notebook in LLaMA-2 blog (#20724)
### Description
This PR updates a reference link in the LLaMA-2 blog post and fixes a
word formatting issue.

### Motivation and Context
With these changes, the link to the example E2E notebook works again.
2024-05-19 22:51:46 -07:00
George Wu
ca6b0f8cb2
[QNN EP] update docs (#20705)
update docs with for version 1.18.0
2024-05-17 11:19:41 -07:00
Hector Li
564d725031
Add error handling session in QNN doc (#20579)
Add error handling session in QNN doc
2024-05-07 10:44:00 -07:00
Yifan Li
f131eb9993
[TensorRT EP] Update doc to TRT10 (#20580)
### Description
<!-- Describe your changes. -->
* Update TRT version to 10.0


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-05-07 10:05:46 -07:00
Maanav Dalal
08407ea351
Fixed accessibility issues, changed word animation. (#20513)
### Description
Addresses #20096, and checked #20261 (should have already been fixed)

Also added a different animation for words on the hero as they didn't
look good (some svelte animation bug I think)

Link found at: https://maanavd.github.io/onnxruntime/

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
2024-04-29 14:59:11 -07:00
Maanav Dalal
521d8922e2
Fixed SEO tags & used external linked images (easiest fix for the time being) (#20455)
Allowing images to work in blog metadata (for social media)

---------

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
2024-04-24 16:39:01 -07:00
Baiju Meswani
5e549a5c24
How to setup the cuda env for windows (#20444) 2024-04-24 16:35:47 -07:00
Maanav Dalal
faf0809e25
fixed repeated text. (#20446)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->

---------

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
2024-04-23 15:15:33 -07:00
Sophie Schoenmeyer
82e2da0819
Update with-python.md with CUDA 12.X instructions (#20442)
### Description
with-python.md does not currently include installation instructions for
CUDA 12.X, so I added the instructions from
https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-23 14:32:17 -07:00
Sophie Schoenmeyer
be0c6c93f5
Update index.md with table of contents (#20441)
### Description
File previously included TOC placeholder instead of actual TOC



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-23 14:32:06 -07:00
Sophie Schoenmeyer
ff5c5c5cdc
Update CUDA-ExecutionProvider.md to add TOC (#20443)
### Description
CUDA-ExecutionProvider.md table of contents previously not showing up
correctly b/c of spacing issue.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-23 14:31:49 -07:00
Maanav Dalal
1afea4b3ec
Adding Phi3 Blog. (#20435)
### Description
Releasing Phi-3 Blog. Viewable demo available on:
https://maanavd.github.io/onnxruntime/blogs

---------

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
Co-authored-by: Sophie Schoenmeyer <107952697+sophies927@users.noreply.github.com>
2024-04-23 12:32:06 -07:00
Nat Kershaw (MSFT)
0ebd6b46ff
Update generate() API docs (#20433)
Light edit of generate() docs
2024-04-23 09:16:55 -07:00
Nat Kershaw (MSFT)
a3eceb52f3
Add build from source for DML (#20384) 2024-04-21 15:00:46 -07:00
Maanav Dalal
f8e689f5f2
Made requested accessibility changes. (#20318)
### Description
Made requested changes from Accessibility audit. Live at:
[maanavd.github.io/onnxruntime/](https://maanavd.github.io/onnxruntime/)



### Motivation and Context
Related issues addressed: 
#20259, #20261, #20263, #20264, #20096, #20100, #20101, #20102, #20103,
#20119, #20120, #20123

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
2024-04-17 14:21:33 -07:00
Yifan Li
55edff104f
[TensorRT EP] Update instruction of user_compute_stream (#20343)
### Description
<!-- Describe your changes. -->
Update instruction and add sample code

### Preview the change:

https://yf711.github.io/onnxruntime/docs/execution-providers/TensorRT-ExecutionProvider.html#execution-provider-options

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-17 13:45:06 -07:00
Nat Kershaw (MSFT)
d3551b0069
Add instructions to build generate() API from source on Mac (#20342)
Staged here:
https://natke.github.io/onnxruntime/docs/genai/howto/build-from-source.html#option-3-build-from-source
2024-04-17 09:22:39 -07:00
Nat Kershaw (MSFT)
92cbb4249d
Improve build instructions (#20251) 2024-04-09 19:12:53 -07:00
Nat Kershaw (MSFT)
4a0a4ce205
Improve generate() API build instructions (#20181)
Staged here:
https://natke.github.io/onnxruntime/docs/genai/howto/build-from-source.html
2024-04-05 11:31:26 -07:00
Phoebe Chen
e31928e7ff
Add Initial Cross-Compilation Documentation for RISC-V Support (#19239)
Update the document for PR: Enable Cross-Compiling Support for ONNX
Runtime on Linux for RISC-V 64-bit.
https://github.com/microsoft/onnxruntime/pull/19238

Signed-off-by: Phoebe Chen <phoebe.chen@sifive.com>
2024-04-05 06:54:18 -07:00
Scott McKay
e0a6a9640b
Update CoreML EP docs (#19844)
### Description
Add new flags and MLProgram supported ops.

### Motivation and Context
Update docs
2024-04-04 21:54:09 -07:00
Manix
435e9a33dc
Update quantization.md for QDQ and dynamic quantization old doc (#20130)
- doc suggests that QDQ model are created with dynamic quant, which is
not the case anymore.
- updating and restructuring the doc

### Description
<!-- Describe your changes. -->
- QDQ model format representation doesn't come for dynamic quantization,
but the doc was suggesting.
- May be a couple of years back this support was there but not anymore


### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
- Clears misunderstanding that QDQ Onnx models can be created with
dynamic quantization.

https://github.com/microsoft/onnxruntime/issues/20125
2024-04-04 21:38:20 -07:00
Sophie Schoenmeyer
4859156a44
Add CUDA 12 instructions to get started table (#20170)
Get Started table currently only includes instructions for
Windows/Python/X64/CUDA and Linux/Python/X64/CUDA for (default) CUDA
11.8. Updating to include installation instructions for CUDA 12.X as
well.
2024-04-03 14:10:53 -07:00
wangshuai09
216231d197
[CANN] Update the doc of CANN EP (#20138)
This PR update docs of Ascend CANN excution provider doc for #20075 

### Changes
1. Add new option
`dump_om_model`: Whether to dump the OM(Offlined Model for Aasend Npu)
to disk

---------

Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
2024-04-01 21:36:05 -07:00
Nat Kershaw (MSFT)
1ef08b350f
Add install ONNX Runtime from nightly (#20131)
### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-04-01 21:33:46 -07:00
Yulong Wang
73173cc2c2
[doc] update Web tutorial (#19849)
### Description
This PR re-arranges "tutorial" documentation of ORT web on
onnxruntime.ai

Current doc: https://onnxruntime.ai/docs/
Change preview: https://fs-eire.github.io/onnxruntime/docs/

### Changes

- Added page:
- [`Using
WebGPU`](https://fs-eire.github.io/onnxruntime/docs/tutorials/web/ep-webgpu.html)
- [`Working with Large
Models`](https://fs-eire.github.io/onnxruntime/docs/tutorials/web/large-models.html)
- [`Performance
Diagnosis`](https://fs-eire.github.io/onnxruntime/docs/tutorials/web/performance-diagnosis.html)
- [`Deploying ONNX Runtime
Web`](https://fs-eire.github.io/onnxruntime/docs/tutorials/web/deploy.html)
-
[`Troubleshooting`](https://fs-eire.github.io/onnxruntime/docs/tutorials/web/trouble-shooting.html)
(a placeholder for now)
2024-03-26 14:48:21 -07:00
rui-ren
f3efd8d265
a small fix for installation command (#20046)
Previous Command cannot `copy/paste` and install directly in terminal.
2024-03-23 10:22:57 -07:00
Tianlei Wu
a62200665e
[Doc] Update CUDA and cuDNN installation (#20035)
(1) Add CUDA and cuDNN installation section to ORT installation.
(2) For build, TRT EP refers to CUDA EP for CUDA/cuDNN installation to avoid duplication.
(3) Add comments about CUDA/cuDNN compatiblility
2024-03-22 16:38:08 -07:00
Jeff Mendenhall
180cb20298
Update QNN-ExecutionProvider.md (#20017)
update to link to Qualcomm SDK docs

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
2024-03-21 16:30:16 -07:00
Maanav Dalal
e8b82b6f3f
Large UX updates, replaced banner, moved analytics, linted everything (#20004)
https://maanavd.github.io/onnxruntime/

### Description
Many changes, most small, but quite a few. Listed here:

- Infinitely scrolling testimonial banner on homepage
- New Microsoft-approved cookie consent banner (only shows up in correct
regions, here's a screen of it working):
![image](https://github.com/microsoft/onnxruntime/assets/24942306/b210b55f-d0cb-413a-a5c7-7156e003414a)
You can duplicate this behavior if you want using: [this
link](https://eng.ms/docs/cloud-ai-platform/devdiv/one-engineering-system-1es/1es-docs/wcp/privacy/wcp-cookie-consent-api#cookie-consent-library---javascript:~:text=siteConsent.manageConsent()%3B%0A%20%20%20%20%7D-,How%20to%20test%20if%20banner%20is%20loading%20for%20EU%20visitors,-You%20can%20use)
- removed SAOS animations, relying on native tailwind animations
- ran a linting pass
- easter egg for hovering onnxruntime pinwheel

---------

Co-authored-by: MaanavD <maanavdalal@microsoft.com>
2024-03-21 14:40:45 -07:00