This repository contains the code supporting the GPT-4V base model for use with Autodistill.

GPT-4V, developed by OpenAI, is a multi-modal language model. With GPT-4V, you can ask questions about images in natural language. The autodistill-gpt4v module enables you to classify images using GPT-4V.

This model uses the gpt-4-vision-preview API announced by OpenAI on November 6th, 2023.

Read the full Autodistill documentation.

Read the GPT-4V Autodistill documentation.

To use GPT-4V with autodistill, you need to install the following dependency:

pip3 install autodistill-gpt-4v

from autodistill_gpt_4v import GPT4V

# define an ontology to map class names to our GPT-4V prompt
# the ontology dictionary has the format {caption: class}
# where caption is the prompt sent to the base model, and class is the label that will
# be saved for that caption in the generated annotations
# then, load the model
base_model = GPT4V(
    ontology=CaptionOntology(
        {
            "person": "person",
            "a forklift": "forklift"
        }
    ),
    api_key="OPENAI_API_KEY"
)
base_model.label("./context_images", extension=".jpeg")

This project is licensed under an MIT license.

We love your input! Please see the core Autodistill contributing guide to get started. Thank you 🙏 to all our contributors!