Skip to content

Commit

Permalink
incorporates Charles' final review
Browse files Browse the repository at this point in the history
  • Loading branch information
benironside committed Jul 5, 2024
1 parent ff906fe commit 5cd2350
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/serverless/assistant/connect-to-byo-llm.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -84,12 +84,15 @@ You can use Elastic's [Nginx integration](https://www.elastic.co/docs/current/in

## Configure LM Studio and download a model

First, install LM Studio. LM Studio supports the OpenAI SDK, which makes it compatible with Elastic's OpenAI connector, so you can connect Elastic AI Assistant to any model available in the LM Studio marketplace.
First, install [LM Studio](https://lmstudio.ai/). LM Studio supports the OpenAI SDK, which makes it compatible with Elastic's OpenAI connector, allowing you to connect to any model available in the LM Studio marketplace.

One current limitation of LM Studio is that when it is installed on a server, you must launch the application using its GUI before doing so using the CLI. For example, by using Chrome RDP with an [X Window System](https://cloud.google.com/architecture/chrome-desktop-remote-on-compute-engine). After you've opened the application the first time using the GUI, you can start it by using `sudo lms server start` in the CLI.

Once you've launched LM Studio, select a model:

<DocImage url="images/lms-model-select.png" alt="The LM Studio model selection interface"/>


<DocCallOut title="Important">
For security reasons, before downloading a model, verify that it is from a trusted source. It can be helpful to review community feedback on the model (for example using a site like Hugging Face).
</DocCallOut>
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 5cd2350

Please sign in to comment.