intermodel is a lightweight Python library for interacting with large language models. It supports autoregressively completing text and tokenizing text.
Its main features are:
- Multi-vendor: The same model can be served by multiple vendors
- Model aliases: Models can be given friendly names to make them easier to name
- In progress: Cost estimation
- In progress: Support for fine-tuned and custom models
- In progress: Strong typing
- Todo:
Install as dependency:
git clone [email protected]:CrazyPython/intermodel.git
cd my-project/
pip3 install ../intermodel
Install as independent program:
git clone [email protected]:CrazyPython/intermodel.git
cd intermodel/
pip3 install .