Petals Integrations

• 🔗 Langchain: Building applications with LLMs through composability.

  Docs for Petals integration: https://python.langchain.com/docs/integrations/llms/petals_example

• 🚅 LiteLLM: Call all LLM APIs using the OpenAI format.

  Docs for Petals integration: https://docs.litellm.ai/docs/providers/petals

• 🐛 InSeq: Pytorch-based hackable toolkit to democratize the access to common post-hoc interpretability analyses of sequence generation models.

  Tutorial on attributing distributed LLMs with Petals: https://inseq.readthedocs.io/en/latest/examples/petals.html

• 💬 ChatGPT-web UI by @niek.