Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAG, RAFT or Fine-Tuning Models #910

Open
euroblaze opened this issue Nov 22, 2024 · 0 comments
Open

RAG, RAFT or Fine-Tuning Models #910

euroblaze opened this issue Nov 22, 2024 · 0 comments

Comments

@euroblaze
Copy link

euroblaze commented Nov 22, 2024

What's the community thinking about RAGing, RAFTing or Fine-Tuning opensource models, for the specific purpose of DevOps, Sys-Admin, MLOps or for that matter any such task-domain?

From what I understood so far about gptscript, tools are the space where a user can express needs.

But in my (very) initial tests, just typing ls on the gptscript prompt (llm-basics-demo) is yielding this output.

my@dev1:~$ gptscript github.com/gptscript-ai/llm-basics-demo

  Hello! I'm here to help you with any questions or information you might need. How can I assist you today?                       

> ls

  It looks like you're using a command that is common in Unix-based systems to list directory contents. If you need help with     
  something specific related to this command or anything else, feel free to ask!                                                  

@Your Friendly Chat Assistant>  

Every systems guy would expect a different output to the ls prompt.

What are your thoughts on:

  • the LLM "powering" gptscript having some background knowledge related to the intentions of the user?
  • which of RAG, RAFT or Fine-tuning could/would work better? Or are foundational models (remember, their knowledge is old) already the best fit?

Thanks for your views!

@euroblaze euroblaze changed the title ## RAG, RAFT or Fine-Tuning Models RAG, RAFT or Fine-Tuning Models Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant