Skip to content

Commit

Permalink
Repo link
Browse files Browse the repository at this point in the history
  • Loading branch information
natke committed May 20, 2024
1 parent 876d8c4 commit 8e17fbe
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/genai/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,9 @@ nav_order: 6

_Note: this API is in preview and is subject to change._

Run generative AI models with ONNX Runtime. Source code: [https://github.com/microsoft/onnxruntime-genai](https://github.com/microsoft/onnxruntime-genai)
Run generative AI models with ONNX Runtime.

See the source code here: [https://github.com/microsoft/onnxruntime-genai](https://github.com/microsoft/onnxruntime-genai)

This library provides the generative AI loop for ONNX models, including inference with ONNX Runtime, logits processing, search and sampling, and KV cache management.

Expand Down

0 comments on commit 8e17fbe

Please sign in to comment.