saymrwulf/onnxruntime
1
0
Fork 0
mirror of https://github.com/saymrwulf/onnxruntime.git synced 2026-07-17 18:40:28 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
onnxruntime/docs/genai/howto/install.md
Ulrich Bönkemeyer 4b919fe2ac
Fix DirectML package name in genai/howto/install.md (#20771) 
### Description
Fix package name 
from ```dotnet add package Microsoft.ML.OnnxRuntimeGenAI.*Cuda*
--prerelease``` to ```dotnet add package
Microsoft.ML.OnnxRuntimeGenAI.DirectML --prerelease``` in DirectML
section.

### Motivation and Context
Clearly confusing for beginners if not fixed (will break further processes)
2024-05-23 13:16:04 -07:00

1.1 KiB
Raw Blame History

title description has_children parent grand_parent nav_order
Install Instructions to install ONNX Runtime generate() API on your target platform in your environment false How to Generate API (Preview) 1

Install ONNX Runtime generate() API

{: .no_toc }

  • TOC placeholder {:toc}

Python packages

pip install numpy
pip install onnxruntime-genai --pre

Append -directml for the library that is optimized for DirectML on Windows

pip install numpy
pip install onnxruntime-genai-directml --pre

Append -cuda for the library that is optimized for CUDA environments

pip install numpy
pip install onnxruntime-genai-cuda --pre --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/

Nuget packages

dotnet add package Microsoft.ML.OnnxRuntimeGenAI --prerelease

For the package that has been optimized for CUDA:

dotnet add package Microsoft.ML.OnnxRuntimeGenAI.Cuda --prerelease

For the package that has been optimized for DirectML:

dotnet add package Microsoft.ML.OnnxRuntimeGenAI.DirectML --prerelease