saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-14 18:12:05 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update with-python.md with CUDA 12.X instructions (#20442)

Browse source 
### Description
with-python.md does not currently include installation instructions for
CUDA 12.X, so I added the instructions from
https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
This commit is contained in:
Sophie Schoenmeyer 2024-04-23 14:32:17 -07:00 committed by GitHub
parent be0c6c93f5
commit 82e2da0819
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 17 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

20
docs/get-started/with-python.md
View file

@ -20,9 +20,7 @@ Below is a quick guide to get the packages installed to use ONNX for model seria
There are two Python packages for ONNX Runtime. Only one of these packages should be installed at a time in any one environment. The GPU package encompasses most of the CPU functionality.
```bash
pip install onnxruntime-gpu
```
### Install ONNX Runtime CPU
Use the CPU package if you are running on Arm CPUs and/or macOS.
@ -30,6 +28,22 @@ Use the CPU package if you are running on Arm CPUs and/or macOS.
pip install onnxruntime
```
### Install ONNX Runtime GPU (CUDA 11.x)
The default CUDA version for ORT is 11.8.
```bash
pip install onnxruntime-gpu
```
### Install ONNX Runtime GPU (CUDA 12.x)
For Cuda 12.x, please use the following instructions to install from [ORT Azure Devops Feed](https://aiinfra.visualstudio.com/PublicPackages/_artifacts/feed/onnxruntime-cuda-12/PyPI/onnxruntime-gpu/overview)
```bash
pip install onnxruntime-gpu --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/
```
## Install ONNX for model export