### Description
Introduce how to use matmul_4bits_quantizer to do weight only
quantization.
### Motivation and Context
Add 4bit quantizer to onnx runtime doc
This pull request addresses several spelling errors and inconsistencies
in the capitalization of proper nouns within the documentation.
### Motivation and Context
To improve the quality of the documentation, spelling errors and
capitalization mistakes have been corrected. This ensures that the
content is more accurate and easier to read.
### Description
<!-- Describe your changes. -->
- Update Android build instructions.
- Remove references to "mobile" packages with reduced operators and
minimal build which have been removed in 1.19.
In particular, these packages:
- onnxruntime-mobile-c/objc (iOS)
- onnxruntime-mobile (Android)
https://edgchen1.github.io/onnxruntime/docs/
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Update and remove obsolete documentation.
### Description
<!-- Describe your changes. -->
Changing ORT training installation steps
Current command for ORTtraining nightly installation was installing
stable version so creating a fix for this.
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Current command for ORTtraining nightly installation was installing
stable version so creating a fix for this.
Update DML EP docs w/ correct DML + ONNX opset version
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Only open question is if it's correct that Aidan Fitzpatrick, Founder &
CEO of "Reincubate" is the correct person for that testimonial.
Demo available at: https://maanavd.github.io/onnxruntime/
### Description
Python code block on home page contained typo
Previous: outputs = session.run(None {"input": inputTensor})
Correction: outputs = session.run(None, {"input": inputTensor})
Fixes issue #21146
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
DRAFT PR until images and thumbnail are provided
---------
Co-authored-by: Scott McKay <Scott.McKay@microsoft.com>
Co-authored-by: Emma Ning <43255631+EmmaNingMS@users.noreply.github.com>
### Description
Resolving or re-resolving: #20096 , #20118 , #20153 , #20151 , #20152
Done by:
- Adding skip to main content links
- Adding pause carousel
- Fixing H1s
- Fixing color scheme
- Making code blocks appear on mobile / smaller viewports.
### For testing
Please test using mobile and desktop versions, ensuring everything
(especially the landing page) appear as expected!
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This documentation adds documentation on:
- how to allocate CUDA device tensors from C++ and python
- how to use DML device tensors from C++ and python
- it also shows how to leverage existing GPU allocations in ORT
- how to overlap PCI copies and GPU execution using CUDA streams
- how to overlap PCI copies and GPU execution using D3D12 Command Lists
and custom resources
---------
Co-authored-by: Tianlei Wu <tlwu@microsoft.com>
ACPT docs should be nested inside Ecosystem category in the docs
sidebar, but they currently show up outside of the category at the top
of the sidebar.
Need to add parent to address this issue.
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Adding to the docs a link on how to embed an externally compiled engine
and also mention that in case of an embedded engine the builder resource
is not needed.
### Description
Previous footer used an outdated documentation issue template that made
issues more difficult to triage. Updated footer with correct
documentation template.
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
Add an ACPT landing page to the ORT docs to publish supported
configurations + most recent releases
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
Fix broken links referenced in issue #20790
Llama2 blog link was updated to the correct location and ResNet sample
was removed entirely because it no longer exists anywhere in the AML
docs
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Add a section for how to use three major TRT EP caches: TRT timing
cache, TRT engine cache and Embedded engine model /EPContext model.
Some materials are from my GTC slides.
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
update cudnn to 8.9.2.26 (Linux)<br/>8.9.2.26 (Windows)
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
Fix package name
from ```dotnet add package Microsoft.ML.OnnxRuntimeGenAI.*Cuda*
--prerelease``` to ```dotnet add package
Microsoft.ML.OnnxRuntimeGenAI.DirectML --prerelease``` in DirectML
section.
### Motivation and Context
Clearly confusing for beginners if not fixed (will break further processes)
### Description
Update compatibility/version info for ORT 1.18 release
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
### Description
<!-- Describe your changes. -->
### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
