From 2e93b41fabf477a27d81d872c843a6d6a2c2e423 Mon Sep 17 00:00:00 2001 From: "Nat Kershaw (MSFT)" Date: Sun, 17 Mar 2024 20:19:06 -0700 Subject: [PATCH] Update index.md (#19941) --- docs/genai/index.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/genai/index.md b/docs/genai/index.md index 57634b8f89..91d0f5d73f 100644 --- a/docs/genai/index.md +++ b/docs/genai/index.md @@ -9,10 +9,11 @@ nav_order: 6 _Note: this API is in preview and is subject to change._ -Run generative AI models with ONNX Runtime. +Run generative AI models with ONNX Runtime. Source code: https://github.com/microsoft/onnxruntime-genai This library provides the generative AI loop for ONNX models, including inference with ONNX Runtime, logits processing, search and sampling, and KV cache management. Users can call a high level `generate()` method, or run each iteration of the model in a loop, generating one token at a time, and optionally updating generation parameters inside the loop. It has support for greedy/beam search and TopP, TopK sampling to generate token sequences and built-in logits processing like repetition penalties. You can also easily add custom scoring. +