Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.2k 108

  2. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 813 61

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 783 38

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 596 45

  5. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 471 56

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 448 36

Repositories

Showing 10 of 17 repositories
  • ALM-Bench Public

    🔥 ALM-Bench is a multilingual multi-modal diverse cultural benchmark for 100 languages across 19 categories. It assesses the next generation of LMMs on cultural inclusitivity.

    mbzuai-oryx/ALM-Bench’s past year of commit activity
    5 0 0 0 Updated Nov 21, 2024
  • VideoGLaMM Public

    A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

    mbzuai-oryx/VideoGLaMM’s past year of commit activity
    34 0 3 0 Updated Nov 8, 2024
  • Camel-Bench Public

    CAMEL-Bench is an Arabic benchmark for evaluating multimodal models across eight domains with 29,000 questions.

    mbzuai-oryx/Camel-Bench’s past year of commit activity
    Python 19 MIT 1 0 0 Updated Oct 27, 2024
  • BiMediX Public

    Bilingual Medical Mixture of Experts LLM

    mbzuai-oryx/BiMediX’s past year of commit activity
    25 1 1 0 Updated Sep 25, 2024
  • ClimateGPT Public

    [EMNLP'23] ClimateGPT: a specialized LLM for conversations related to Climate Change and Sustainability topics in both English and Arabic languages.

    mbzuai-oryx/ClimateGPT’s past year of commit activity
    Python 75 9 0 0 Updated Sep 24, 2024
  • PALO Public

    (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 81 Apache-2.0 5 5 0 Updated Sep 10, 2024
  • Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

    mbzuai-oryx/Video-ChatGPT’s past year of commit activity
    Python 1,224 CC-BY-4.0 108 19 0 Updated Aug 27, 2024
  • CVRR-Evaluation-Suite Public

    Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite for Video-LMMs".

    mbzuai-oryx/CVRR-Evaluation-Suite’s past year of commit activity
    Python 42 CC-BY-4.0 4 0 0 Updated Aug 23, 2024
  • BiMediX2 Public

    Bio-Medical EXpert LMM with English and Arabic Language Capabilities

    mbzuai-oryx/BiMediX2’s past year of commit activity
    2 0 0 0 Updated Aug 12, 2024
  • VideoGPT-plus Public

    Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding

    mbzuai-oryx/VideoGPT-plus’s past year of commit activity
    Python 218 CC-BY-4.0 15 15 1 Updated Aug 11, 2024
View all repositories

Top languages

Python