LLM_Inference_System

💬A Chat Based LLM Inference System!

What is this project?

A chat based inference system like oogabooga made using Llama-cpp.

Complete Video Installation Guide

Video Link

Collab Version

OPEN COLLAB

DOCUMENTATION

• LOCAL INSTALLATION GUIDE
• COLLAB GUIDE

🚧 Goals

• Add VectorBase Functionality -- PENDING ⏳
• All many more.

🤝 Contributions

This is an Open-Source project! Anybody is free to contribute here!

👉 Bug Reporting: If you encounter any bugs while using the app, please report them in the issues section of the repository. Make sure to provide a clear description of the issue and steps to reproduce it.

🔨 Pull Requests: If you have a fix or improvement that you would like to contribute, you can create a pull request.

📈 Feature Requests: We also welcome feature requests from the community. If you have an idea for a new feature or improvement, you can submit it in the issues section of the repository.

👏 SUPPORT ME!

If you really like the project please support me through PayPal.

LICENSE

Falls under The MIT License (MIT) Copyright © 2023