Awesome Llama 2

Llama 2 is a second-generation open-source large language model (LLM) from Meta. It can be used to build chatbots like ChatGPT or Google Bard.

Table of Contents

• GitHub projects
• Articles & Blogs
• Online Courses
• Books
• Research Papers
• Videos
• Tools & Software
• Conferences & Events
• Slides & Presentations
• Podcasts

GitHub projects

• Get up and running with Llama 2 and other large language models locally ⭐ (16588 stars)
• Inference Llama 2 in one file of pure C ⭐ (12834 stars)
• A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! ⭐ (9274 stars)
• Llama中文社区，最好的中文Llama大模型，完全开源可商用 ⭐ (6788 stars)
• Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. ⭐ (5355 stars)
• Examples and recipes for Llama 2 model ⭐ (4995 stars)
• 中文LLaMA-2 & Alpaca-2大模型二期项目 + 16K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs, including 16K long context models) ⭐ (4807 stars)
• 开源社区第一个能下载、能运行的中文 LLaMA2 模型！ ⭐ (2024 stars)
• Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use llama2-wrapper as your local llama2 backend for Generative Agents/Apps. ⭐ (1762 stars)
• An Open-source Toolkit for LLM Development ⭐ (1737 stars)
• Inference Llama 2 in one file of pure 🔥 - A repository for running Llama 2 inference in a single file.
• LLaMA v2 Chatbot - A chatbot powered by LLaMA v2.
• Chinese LLaMa2 - An open-source Chinese LLaMa2 repository for simple Chinese Q&A chatbot training.
• Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A - Run Llama 2 and other open-source LLMs on CPU Inference Locally for Document Q&A.
• LLama2.rs - A fast Llama2 decoder in pure Rust.
• Chinese LLaMA2 - Repo for adapting Meta LlaMA2 in Chinese.
• Llama2 Code Interpreter - Enable Llama2 to use code execution, debugging, saving code, code reuse, and internet access.
• Docker Llama2 Chat - A dockerized version of LLaMA2 chatbot.
• LLM Pruner - On the structural pruning of large language models. Supports LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.

Articles & Blogs

• Llama 2: Open Foundation and Fine-Tuned Chat Models : Llama 2 is a collection of pretrained and fine-tuned large language models optimized for dialogue use cases. This article presents the details of Llama 2-Chat models and their performance compared to other open-source chat models.
• How to Finetune Llama 2: A Beginner's Guide : This blog post provides a step-by-step guide on how to fine-tune the Llama 2 - 7B model with a subset of the CodeAlpaca-20k dataset.
• Lessons I learned while I arrived at Llama-2, the long way. : The author shares their experience and insights about Llama 2 and its impact on the NLP community.
• Thoughts from Llama-2 paper : This article discusses the attention mechanism used in Llama 2 and highlights its efficient use of Grouped Query Attention (GQA).
• LLaMA-2 Fine-tuning : The article explores the process of fine-tuning the Llama 2 model using the Hugging Face Transformers library for both inference and fine-tuning.
• Finetuning Llama 2 and Mistral. A beginner's guide to finetuning : This guide provides step-by-step instructions for customizing powerful language models like Llama 2 and Mistral for personal projects.
• The Practical Guide to LLMs: Llama 2 : The practical guide explores the performance of Llama 2-7B and Llama 2-13B models in zero-shot and few-shot settings, highlighting their ROUGE-1 scores.
• Mastering Llama 2: A Comprehensive Guide to Fine-Tuning : This comprehensive guide covers everything from setting up and loading the Llama 2 model to fine-tuning and deployment.
• A Comprehensive Guide to Fine-Tuning Llama 2 for Beginners : The Python script provided in this guide serves as a complete reference for fine-tuning Llama 2 models, including environment setup.
• Running ChatGPT with Llama2 Locally: Comprehensive Step-by-Step Tutorial 🐑: A tutorial explaining the methods for running ChatGPT with Llama2 locally.
• Running Llama 2 on CPU Inference Locally for Document Q&A 🐑: A guide on running quantized open-source LLM applications on CPUs using Llama 2.
• How to Use Llama 2 with an API on AWS to Power Your AI Apps 🐑: A guide covering the process of hosting Llama 2 model on AWS Sagemaker and using it through an API with AWS Lambda.
• Getting Started with Llama 2: A Comprehensive Guide for Developers 🐑: An introductory guide for developers to get started with Llama 2.
• Instruction fine-tuning Llama 2 with PEFT's QLoRa method 🐑: A blog post discussing how to fine-tune Llama 2 7B pre-trained model using the PEFT library and QLoRa method.
• Crafting an AI-Powered Conversationalist: Step-by-Step Guide to Llama 2 Model Implementation 🐑: A step-by-step guide on implementing Llama 2 for building an AI-powered conversationalist.
• Running LLaMA 2 Locally on Ubuntu: A Brief Guide 🐑: A brief guide on running LLaMA 2 locally on Ubuntu.
• Fine-tune Llama 2 with SFT and DPO 🐑: A discussion on fine-tuning the LLAMA 2 model using the SFT and DPO methods.
• Deploy Llama-2 models easily with LMDeploy! 🐑: A guide on how to quickly deploy the Llama-2 models with LMDeploy.
• Finetune Llama 3.1 on GCP for production use cases

Online Courses

• Learn LangChain: Build #22 LLM Apps using OpenAI & Llama 2...
• Create powerful web-based front-ends for your LLM Application using Streamlit. Build real-world LLM powered applications with LangChain, OpenAI, Llama2, Hugging Face.
• LangChain MasterClass- OpenAI LLAMA 2 GPT LLM Apps|| Python...
• Unlock the Power of AI with LangChain. Discover real-world uses of LangChain, Pinecone, OpenAI & LLAMA 2 LLM. Build AI Apps with Streamlit - Hugging Face.
• Getting Started with the ChatGPT API and the Llama 2 Model | Udemy
• Learn everything you need to know about building a chatbot app using ChatGPT API. Integrate the newest Llama 2 models with your Node.js projects.
• Master LangChain Build #15 AI Apps-OpenAI,LLAMA2...
• Learn end to end Next-Gen AI projects with Langchain, Pinecone, OpenAI, HuggingFace & LLAMA 2 models.
• Generative AI with Large Language Models | Coursera
• Learn the fundamentals of how generative AI works and how to deploy it using Large Language Models (LLMs).
• Query Your Custom Documents using LlamaIndex | Udemy
• Learn how to build LLM applications using LlamaIndex from scratch in Python. Perform queries on your indexed data and integrate LlamaIndex with different LLM models.
• LlamaIndex: Train ChatGPT (& other LLMs) on Custom Data | Udemy
• Your ultimate guide to customizing ChatGPT (and other LLMs) with LlamaIndex. Create LLM applications with LlamaIndex.
• LlamaIndex- Develop LLM powered applications with LlamaIndex...
• Welcome to the first LlamaIndex Udemy course. Learn LlamaIndex by building a real-world generative AI LLM powered application in Python.
• Master Vector Database with Python for AI & LLM Use Cases | Udemy
• Dive into the exciting world of cutting-edge technologies. Learn Vector Database using Python, Pinecone, LangChain, Open AI, Hugging Face, and build AI, ML, Chat applications.
• Mastering Language Models: Unleashing the Power of LLMs...
• Understand the fundamentals of Language Models and Natural Language Processing (NLP). Master the application of pre-trained Language Models. A comprehensive guide to Advanced NLP and Large Language Models (LLMs).
• LangChain with Python Bootcamp | Udemy
• Welcome to the LangChain Udemy course: Unlock the Power of Language Models with Python! Ready to develop cutting-edge applications powered by language models? Build real-world applications with Large Language Models and LangChain!
• LangChain Crash Course: Build OpenAI LLM powered Apps | Udemy
• In this short course, we take you on a fun, hands-on, and pragmatic journey to learn how to build LLM powered apps using LangChain. Fast track to building OpenAI LLM powered Apps using Python.
• Fine-Tuning Fundamentals: Unlocking the Potential of LLMs | Udemy
• A practical course on building chatGPT style models. This course includes 1.5 hours on-demand video, 2 articles, full lifetime access, access on mobile and TV, a certificate of completion, and closed annotations.
• Llama 2 : Le cours ultime sur l'IA conversationnelle de Meta | Udemy
• Le guide complet sur Llama 2, l'intelligence artificielle conversationnelle libre, gratuite et open source de Meta. (The complete guide to Llama 2, Meta's free, open-source conversational artificial intelligence).
• Introduction to LangChain | Udemy
• What you'll learn: Build software applications with Large Language models, learn how to augment LLMs with tools and databases, learn how to build Software Applications with Large Language Models.

Books

• Fine-tune Llama 2 for text generation on Amazon SageMaker - Explore the capabilities of fine-tuning Llama 2 models for text generation using Amazon SageMaker JumpStart.

Research Papers

• Llama 2: Open Foundation and Fine-Tuned Chat Models: This paper presents Llama 2, a collection of pretrained and fine-tuned large language models optimized for dialogue use cases. The models outperform open-source chat models on various benchmarks and provide detailed insights into fine-tuning and safety improvements.
• Effective Long-Context Scaling of Foundation Models: This paper introduces a series of long-context large language models (LLMs) built by continual pretraining from Llama 2. These models support effective context windows of up to 32,768 tokens and achieve consistent improvements on regular and long-context tasks over Llama 2.
• Code Llama: Open Foundation Models for Code: The authors release Code Llama, a family of large language models for code based on Llama 2. These models provide state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks.
• Financial News Analytics Using Fine-Tuned Llama 2 GPT Model: This paper explores the fine-tuning of Llama 2 GPT large language model for multitask analysis of financial news. The study demonstrates the model's ability to analyze, highlight main points, summarize, and extract named entities with appropriate sentiments, enabling structured financial news analysis.
• Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca: The paper proposes a method to augment LLaMA with capabilities for understanding and generating Chinese text. It extends LLaMA's existing vocabulary with Chinese tokens, incorporates secondary pre-training using Chinese data, and fine-tunes the model with Chinese instruction datasets, enhancing its encoding efficiency and semantic understanding of Chinese.
• LLaMA: Open and Efficient Foundation Language Models: This paper introduces LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. These models are trained on publicly available datasets exclusively, without resorting to proprietary datasets, and outperform GPT-3 on various benchmarks.
• Fine-Tuning Llama 2 Large Language Models for Detecting Online...: The paper proposes an approach to detecting online sexual predatory chats and abusive language using the open-source pretrained Llama 2 7B-parameter model. The approach is generic, automated, and fine-tunes the model using datasets in different languages.
• Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation: This paper evaluates the use of the open-source Llama-2 model for generating high-performance computing kernels on different parallel programming models and languages, comparing its accuracy to GPT-3.
• LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model: This paper presents LLaMA-Adapter V2, a parameter-efficient visual instruction model that improves the ability of large language models to handle open-ended visual instructions.
• ChatDoctor: A Medical Chat Model Fine-Tuned on a Specialized LLaMA: This research focuses on enhancing the medical knowledge of large language models, like ChatGPT, by creating a specialized language model with improved accuracy in medical advice.
• Label Supervised LLaMA Finetuning: This paper explores the potential of leveraging latent representations from LLaMA large language models for supervised label prediction, particularly in sequence and token classification tasks.
• Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: This work investigates the potential of using LLaMA for targeted scenarios, focusing on the writing assistance scenario, and demonstrates the improvement achieved through fine-tuning LLaMA on writing instruction data.
• PMC-LLaMA: Towards Building Open-source Language Model for Medical Applications: This paper describes the process of adapting a general-purpose language model towards medical domain applications, including data-centric knowledge injection and comprehensive fine-tuning for alignment with domain-specific instructions.
• Llama 2: Open Foundation and Fine-Tuned Chat Models: This work develops and releases Llama 2, a collection of pretrained and fine-tuned large language models optimized for dialogue use cases, which can be a suitable substitute for closed-source models.
• LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2: This paper explores the robustness of safety training in language models by subversively fine-tuning the public weights of Llama 2-Chat models, using the low-rank adaptation (LoRA) technique.

Videos

• Meta Llama 2: The Beginner's Guide! (Trained on 2 TRILLION ... - A video providing an introduction and guide to Meta Llama 2, a second-generation open-source large language model.
• Llama 2: Open Source LLM for Research and Commercial ... - Explore Llama 2, the latest offering from Meta AI, which includes an expanded context window and improved capabilities for research and commercial purposes.
• Llama 2: Full Breakdown - YouTube - A breakdown of Llama 2, with insights into its capabilities, potentially including global-scale applications.
• Fine Tune LLaMA 2 In FIVE MINUTES! - "Perform 10x Better For My ... - A tutorial video demonstrating how to fine-tune LLaMA 2 in just five minutes for improved performance.
• I used LLaMA 2 70B to rebuild GPT Banker...and its AMAZING (LLM ... - Learn how to use Llama 2, specifically the 70B variant, to rebuild GPT Banker and witness its impressive capabilities.
• How To Install LLaMA 2 Locally + Full Test (13b Better Than 70b ... - A step-by-step guide on installing LLaMA 2 locally, including a full test using the 13b fp16 version.
• I Built an AI Trading Bot with Llama 2! - YouTube - Discover how Llama 2 can be utilized to build an AI trading bot, with code and resources provided.
• The EASIEST way to finetune LLAMA-v2 on local machine! - YouTube - Learn the easiest, simplest, and fastest way to finetune Llama-v2 on your local machine for a custom dataset.
• Better Llama 2 with Retrieval Augmented Generation (RAG) - YouTube - Explore the improved capabilities of Llama 2 with Retrieval Augmented Generation (RAG) for enhanced performance.
• LLAMA-2 : EASIET WAY To FINE-TUNE ON YOUR DATA - YouTube - A tutorial video demonstrating the easiest way to fine-tune the Llama-2 model on your own data using the auto train-advanced package.
• NEW A.I. By Meta Is THAT Good? LLaMA 2 Fully Tested - YouTube : In this video, LLaMA2 70b is tested through the LLM rubric to determine its performance.
• How to use the Llama 2 LLM in Python - YouTube : Learn how to use Llama 2, an open-source large language model created by Meta AI, in Python.
• Llama 2 in LangChain — FIRST Open Source Conversational Agent - YouTube : Discover how to use Llama 2, the best-performing open-source Large Language Model (LLM), in LangChain.
• Build and Run a Medical Chatbot using Llama 2 on CPU Machine - YouTube : Follow this tutorial video to learn how to build a sophisticated Medical Chatbot using Llama 2 and powerful open-source technologies.
• Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your... - YouTube : Access a full-text tutorial on how to fine-tune Llama 2 on a custom dataset and train your own LLM.
• Introduction to Llama 2 on Google Cloud - YouTube : Get started with Llama 2 on Google Cloud and learn how to deploy and fine-tune it using Vertex AI.
• Llama-2 with LocalGPT: Chat with YOUR Documents - YouTube : This video demonstrates how to use Llama-2, released by Meta, as part of LocalGPT to chat with your own documents.
• Getting Started with LangChain and Llama 2 in 15 Minutes - YouTube : Learn the fundamental building blocks of LangChain and explore prompt templates using Llama 2 in just 15 minutes.
• Meta LLama 2 Foundational Model with Prompt Flow - YouTube : Unfortunately, the video cannot be played.
• fine tuning llama-2 to code - YouTube : In this video, Llama-2 is fine-tuned on a programming language it doesn't know how to program.

Tools & Software

• DeepL Write: A language translation tool that can be utilized as an alternative to Llama 2.
• HuggingChat : An open-source collection of pretrained language models, including chatbots, which can serve as an alternative to Llama 2.
• Llama 2 Reviews and Pricing 2023
• Learn about Llama 2. Read Llama 2 reviews from real users, and view pricing and features of the Large Language Models software.
• BERT vs. Llama 2 Comparison
• Compare BERT and Llama 2 using this comparison chart.
• Best Llama 2 Alternatives 2023 | Capterra
• Looking for alternatives to Llama 2? Find out how Llama 2 stacks up against its competitors with real user reviews, pricing information, and features they offer.
• LLaMA vs. Llama 2 Comparison
• Compare LLaMA and Llama 2 to make the best choice for your needs.
• Llama 2 vs. StarCoder Comparison
• Compare Llama 2 and StarCoder using this comparison chart.
• Amazon Titan vs. Llama 2 Comparison
• Compare Amazon Titan and Llama 2 to make the best choice for your needs.
• Jurassic-2 vs. Llama 2 Comparison
• Compare Jurassic-2 and Llama 2 to make the best choice for your needs.
• Hippocratic AI vs. Llama 2 Comparison
• Compare Hippocratic AI and Llama 2 to make the best choice for your needs.
• Claude vs. Llama 2 Comparison
• Compare Claude and Llama 2 using this comparison chart.
• Llama Life - Product Information, Latest Updates, and Reviews 2023...
• Llama Life is an app that enhances productivity with features like colored tasks, presets, and showing the end time of tasks.

Conferences & Events

• Prompt Camp Miami Experience - Creatively Leveraging AI Tools for Your Biz An event focused on leveraging AI tools for business. Link
• Code Llama: Open Foundation Models for Code Virtual London Machine Learning Meetup discussing open foundation models for code. Link
• Find Data Science Events & Groups in Ahmedabad, IN
• ML Meetups Virtual | Meetup
• AI Meetups by Deep Tech Stars | Meetup

Slides & Presentations

• LLaMA Open and Efficient Foundation Language Models - 230528.pdf - In-depth review of LLaMA 2 as an open and efficient language model.
• Llama-index | PPT 💻: A presentation about Llama-index, a toolkit designed to easily connect LLM's with your external data.
• LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention.pdf 💻: A slide presentation introducing LLaMA-Adapter, an efficient method for fine-tuning language models with zero-init attention.

Podcasts

• Super Data Science: ML & AI Podcast with Jon Krohn: 702: Llama 2 — It's Time to Upgrade your Open-Source LLM: Jon Krohn examines Meta's newly released open-source large language model, Llama 2, highlighting its commercial prospects and immense capacity. (🎧)
• This Day in AI Podcast on Apple Podcasts - A podcast discussing AI-related topics, including a humorous segment about Ed Sheeran.
• Marketing Over Coffee Marketing Podcast en Apple Podcasts - Learn about Llama 2 Long, Taylor Swift ruling the earth, AI, pet detection, and more in this marketing-focused podcast.
• Open Source Startup Podcast on Apple Podcasts - A discussion about the importance of supporting multiple models and advancements in the LLaMA and Stable Diffusion projects.

---

This initial version of the Awesome List was generated with the help of the Awesome List Generator. It's an open-source Python package that uses the power of GPT models to automatically curate and generate starting points for resource lists related to a specific topic.