Upcoming Features

Welcome to the LLMinator wiki!

in Pipeline:

• Config.ini for saving model information & config (P1)
• Command line args --host --port & --share
• Default model to be stabilityai/stable-code-instruct-3b(P1)
• Popular Model Suggestions(P2)
• llama.cpp integration (P2)
• API Access (P3)
  • Get & Set Repo ID
  • Send prompt & receive responses
  • Get/Select/Remove Cached Model(Later)
• HF Repo Search (P3)

Done:

• Stop Generation ✅

• Change execution Provider ✅

• Clear Cache/Offload Models ✅

  • Custom Cache Dir ✅
  • List Models From Dir ✅
  • Select/Load any download models ✅

• Command Line Arg for --host & --port ✅

• Error Handling ✅