Skip to content

Latest commit

 

History

History
220 lines (195 loc) · 7.58 KB

supported_examples.md

File metadata and controls

220 lines (195 loc) · 7.58 KB
Raw

Supported Examples

This document introduces the supported examples of GenAIExamples. The supported Vector Database, LLM models, serving frameworks and hardwares are listed as below.

ChatQnA

ChatQnA is an example of chatbot for question and answering through retrieval augmented generation (RAG).

Framework LLM Embedding Vector Database Serving HW Description
LangChain/LlamaIndex NeuralChat-7B BGE-Base Redis TGI TEI Xeon/Gaudi2/GPU Chatbot
LangChain/LlamaIndex NeuralChat-7B BGE-Base Chroma TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B BGE-Base Redis TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B BGE-Base Qdrant TGI TEI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Qwen2-7B BGE-Base Redis TEI Xeon/Gaudi2 Chatbot

CodeGen

CodeGen is an example of copilot designed for code generation in Visual Studio Code.

Framework LLM Serving HW Description
LangChain/LlamaIndex meta-llama/CodeLlama-7b-hf TGI Xeon/Gaudi2 Copilot

CodeTrans

CodeTrans is an example of chatbot for converting code written in one programming language to another programming language while maintaining the same functionality.

Framework LLM Serving HW Description
LangChain/LlamaIndex HuggingFaceH4/mistral-7b-grok TGI Xeon/Gaudi2 Code Translation

DocSum

DocSum is an example of chatbot for summarizing the content of documents or reports.

Framework LLM Serving HW Description
LangChain/LlamaIndex NeuralChat-7B TGI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B TGI Xeon/Gaudi2 Chatbot

Language Translation

Language Translation is an example of chatbot for converting a source-language text to an equivalent target-language text.

Framework LLM Serving HW Description
LangChain/LlamaIndex haoranxu/ALMA-13B TGI Xeon/Gaudi2 Language Translation

SearchQnA

SearchQnA is an example of chatbot for using search engine to enhance QA quality.

Framework LLM Serving HW Description
LangChain/LlamaIndex NeuralChat-7B TGI Xeon/Gaudi2 Chatbot
LangChain/LlamaIndex Mistral-7B TGI Xeon/Gaudi2 Chatbot

VisualQnA

VisualQnA is an example of chatbot for question and answering based on the images.

LLM HW Description
LLaVA-1.5-7B Gaudi2 Chatbot

NOTE: The Language Translation, SearchQnA, VisualQnA and other use cases not listing here are in active development. The code structure of these use cases are subject to change.