feat(ollama): init

[shivaraj-bh]

ported from https://github.com/shivaraj-bh/ollama-flake/blob/main/services/ollama.nix

TODO

• Add documentation that includes examples for using accelerators like cuda and rocm

[srid]

@shivaraj-bh

https://x.com/nixos_asia/status/1800855562072322052

Is there a nix run one-liner I can use to try out the demo in the tweet without having to hand-roll a flake? Perhaps an ./example/llm is useful. I wanted to retweet that to my profile giving the nix run ... invocation for readers.

[shivaraj-bh]

@srid here you go: 82ff0e9

[srid]

This is what I see when trying to run it (cf. #222):

❯ nix run "github:juspay/services-flake?dir=example/llm"
error:
       … while updating the lock file of flake 'github:juspay/services-flake/76f6081f51d8884b7d3196dbb45e8f8a11417a53?dir=example/llm'

       error: cannot write modified lock file of flake 'github:juspay/services-flake?dir=example/llm' (use '--no-write-lock-file' to ignore)

Also, we should build all examples in CI. See #221