onnxruntime/docs/genai/howto/install.md

title	description	has_children	parent	grand_parent	nav_order
Install	Instructions to install ONNX Runtime generate() API on your target platform in your environment	false	How to	Generate API (Preview)	1

Install ONNX Runtime generate() API

{: .no_toc }

• TOC placeholder {:toc}

Python packages

pip install numpy
pip install onnxruntime-genai --pre

Append -directml for the library that is optimized for DirectML on Windows

pip install numpy
pip install onnxruntime-genai-directml --pre

Append -cuda for the library that is optimized for CUDA environments

pip install numpy
pip install onnxruntime-genai-cuda --pre --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/

Nuget packages

dotnet add package Microsoft.ML.OnnxRuntimeGenAI --prerelease

For the package that has been optimized for CUDA:

dotnet add package Microsoft.ML.OnnxRuntimeGenAI.Cuda --prerelease

For the package that has been optimized for DirectML:

dotnet add package Microsoft.ML.OnnxRuntimeGenAI.Cuda --prerelease