Skip to content

Commit

Permalink
Update install.md for release
Browse files Browse the repository at this point in the history
  • Loading branch information
natke authored Apr 11, 2024
1 parent 92cbb42 commit 2b146fa
Showing 1 changed file with 7 additions and 16 deletions.
23 changes: 7 additions & 16 deletions docs/genai/howto/install.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: Install
description: Instructions to install ONNX Runtime GenAI on your target platform in your environment
description: Instructions to install ONNX Runtime generate() API on your target platform in your environment
has_children: false
parent: How to
grand_parent: Generative AI (Preview)
Expand All @@ -13,7 +13,7 @@ nav_order: 1
* TOC placeholder
{:toc}

## Python package release candidates
## Python package

```bash
pip install numpy
Expand All @@ -26,28 +26,19 @@ Append `-cuda` for the library that is optimized for CUDA environments
pip install onnxruntime-genai-cuda --pre --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/pypi/simple/
```

## Nuget package release candidates
## Nuget package

To install the NuGet release candidates, add a new package source in Visual Studio, go to `Project` -> `Manage NuGet Packages`.
Add the `Microsoft.ML.OnnxRuntimeGenAI` package

1. Click on the `Settings` cog icon

2. Click the `+` button to add a new package source

- Change the Name to `onnxruntime-genai`
- Change the Source to `https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-genai/nuget/v3/index.json`

3. Check the `Include prerelease` button

4. Add the `Microsoft.ML.OnnxRuntimeGenAI` package

5. Add the `Microsoft.ML.OnnxRuntime` package
Add the `Microsoft.ML.OnnxRuntime` package

To run with CUDA, use the following packages instead:

- `Microsoft.ML.OnnxRuntimeGenAI.Cuda`
- `Microsoft.ML.OnnxRuntime.Gpu`

## C/C++ binaries

_Coming soon_


0 comments on commit 2b146fa

Please sign in to comment.