Skip to content

Commit

Permalink
chore(docs) : adds necessity of GPU
Browse files Browse the repository at this point in the history
  • Loading branch information
rajadilipkolli authored Apr 5, 2024
1 parent d19583d commit d29b1db
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions rag/rag-springai-ollama-llm/ReadMe.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@

The use of the pgvector store with the ollama model is not feasible due to the generation of 4096 dimensions by the latter, which exceeds pg vector's indexing support limit of less than 2000 dimensions. This limitation hinders the ease of querying the embedding store due to the absence of indexing.

As LLMs needs heavy computational power, it needs GPU to be enabled for quickly processing using the complex Math operations behind the scenens.

### Testcontainers support

This project uses [Testcontainers at development time](https://docs.spring.io/spring-boot/docs/3.2.4/reference/html/features.html#features.testing.testcontainers.at-development-time).
Expand Down

0 comments on commit d29b1db

Please sign in to comment.