Merge branch 'main' into open-webui

juspay · Jun 13, 2024 · bd7d185 · bd7d185
2 parents d3d0ced + 4cb3824
commit bd7d185
Show file tree

Hide file tree

Showing 3 changed files with 116 additions and 2 deletions.
diff --git a/doc/ollama.md b/doc/ollama.md
@@ -1,6 +1,6 @@
 # Ollama
 
-[Ollama](https://github.com/ollama/ollama) enables you to get up and running with Llama 3, Mistral, Gemma, and other large language models.
+[Ollama](https://github.com/ollama/ollama) enables you to easily run large language models (LLMs) locally. It supports Llama 3, Mistral, Gemma and [many others](https://ollama.com/library).
 
 ## Getting Started
 
@@ -15,7 +15,9 @@
 
 By default Ollama uses the CPU for inference. To enable GPU acceleration:
 
-### Cuda
+### CUDA
+
+For NVIDIA GPUs.
 
 ```nix
 # In `perSystem.process-compose.<name>`
@@ -29,6 +31,8 @@ By default Ollama uses the CPU for inference. To enable GPU acceleration:
 
 ### ROCm
 
+For Radeon GPUs.
+
 ```nix
 # In `perSystem.process-compose.<name>`
 {

diff --git a/example/llm/flake.lock b/example/llm/flake.lock
diff --git a/flake.nix b/flake.nix
@@ -17,6 +17,10 @@
         inherit overrideInputs;
         dir = "./example/simple";
       };
+      llm-example = {
+        inherit overrideInputs;
+        dir = "./example/llm";
+      };
       share-services-example = {
         overrideInputs = {
           inherit (overrideInputs) services-flake;