Skip to content

RunwayML Gen2 and Gen3 unofficial client to generate videos using AI

License

Notifications You must be signed in to change notification settings

igolaizola/vidai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

43 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

vidai 📹🤖

vidai generates videos using AI.

This is a CLI tool for RunwayML that adds some extra features on top of it. It now also supports Gen3 and Gen3 Turbo models!

📢 Connect with us! Join our Telegram group for support and collaboration: t.me/igohub

🚀 Features

  • Generate videos directly from the command line using a text or image prompt.
  • Support for RunwayML Gen-2, Gen3, and Gen3 Turbo models.
  • Use RunwayML's extend feature to generate longer videos.
  • Create or extend videos longer than 10 seconds by reusing the last frame of the video as the input for the next generation.
  • Other handy tools to edit videos, like generating loops.
  • Explore mode for unlimited generations (credit mode is used by default).

📦 Installation

You can use the Golang binary to install vidai:

go install github.com/igolaizola/vidai/cmd/vidai@latest

Or you can download the binary from the releases

📋 Requirements

You need to have a RunwayML account and extract the token from the request authorization header using your browser's developer tools.

To create extended videos, you need to have ffmpeg installed.

🕹️ Usage

Some examples

Generate a video using Gen3 Turbo model from an image prompt:

vidai generate --token RUNWAYML_TOKEN --image car.jpg --output car.mp4 --model gen3-turbo

Generate a video using Gen3 model from a text prompt:

vidai generate --token RUNWAYML_TOKEN --text "a car in the middle of the road" --output car.mp4 --model gen3

Generate a video from an image prompt with additional options:

vidai generate --token RUNWAYML_TOKEN --image car.jpg --output car.mp4 --interpolate --upscale --watermark --width 1024 --height 576 --explore

Extend a video by reusing the last frame multiple times:

vidai extend --token RUNWAYML_TOKEN --input car.mp4 --output car-extended.mp4 --n 3

Convert a video to a loop:

vidai loop --input car.mp4 --output car-loop.mp4

Help

Launch vidai with the --help flag to see all available commands and options:

vidai --help

You can use the --help flag with any command to view available options:

vidai generate --help

How to launch commands

Launch commands using a configuration file:

vidai generate --config vidai.conf
# vidai.conf
token RUNWAYML_TOKEN
image car.jpg
output car.mp4
model gen3-turbo
interpolate true
upscale true
watermark false
explore true

Using environment variables (VIDAI prefix, uppercase and underscores):

export VIDAI_TOKEN=RUNWAYML_TOKEN
export VIDAI_IMAGE="car.jpg"
export VIDAI_OUTPUT="car.mp4"
export VIDAI_MODEL="gen3-turbo"
export VIDAI_INTERPOLATE=true
export VIDAI_UPSCALE=true
export VIDAI_WATERMARK=false
export VIDAI_EXPLORE=true
vidai generate

Using command line arguments:

vidai generate --token RUNWAYML_TOKEN --image car.jpg --output car.mp4 --model gen3 --interpolate --upscale --explore

⚠️ Disclaimer

The automation of RunwayML accounts is a violation of their Terms of Service and will result in your account(s) being terminated.

Read about RunwayML Terms of Service and Community Guidelines.

vidai was written as a proof of concept and the code has been released for educational purposes only. The authors are released of any liabilities which your usage may entail.

💖 Support

If you have found my code helpful, please give the repository a star ⭐

Additionally, if you would like to support my late-night coding efforts and the coffee that keeps me going, I would greatly appreciate a donation.

You can invite me for a coffee at ko-fi (0% fees):

ko-fi

Or at buymeacoffee:

buymeacoffee

Donate to my PayPal:

paypal.me/igolaizola

Sponsor me on GitHub:

github.com/sponsors/igolaizola

Or donate to any of my crypto addresses:

  • BTC bc1qvuyrqwhml65adlu0j6l59mpfeez8ahdmm6t3ge
  • ETH 0x960a7a9cdba245c106F729170693C0BaE8b2fdeD
  • USDT (TRC20) TD35PTZhsvWmR5gB12cVLtJwZtTv1nroDU
  • USDC (BEP20) / BUSD (BEP20) 0x960a7a9cdba245c106F729170693C0BaE8b2fdeD
  • Monero 41yc4R9d9iZMePe47VbfameDWASYrVcjoZJhJHFaK7DM3F2F41HmcygCrnLptS4hkiJARCwQcWbkW9k1z1xQtGSCAu3A7V4

Thanks for your support!