From 1498dfedc9cea0b082cfc9500a70cbef99c5c7a1 Mon Sep 17 00:00:00 2001 From: Albert Kim Jr Date: Wed, 26 Jun 2024 22:57:03 -0400 Subject: [PATCH] Update README.md for LiteLLM support Closes #201 --- README.md | 31 ++++++++++++++++++++++++++++++- 1 file changed, 30 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 4d076e39..754fb666 100644 --- a/README.md +++ b/README.md @@ -212,6 +212,35 @@ agentops.end_session('Success') +### LiteLLM + +AgentOps provides support for LiteLLM(>=1.3.1), allowing you to call 100+ LLMs using the same Input/Output Format. + +- [AgentOps integration example](https://docs.agentops.ai/v1/integrations/litellm) +- [Official LiteLLM documentation](https://docs.litellm.ai/docs/providers) + +
+ Installation + +```bash +pip install litellm +``` + +```python python +# Do not use LiteLLM like this +# from litellm import completion +# ... +# response = completion(model="claude-3", messages=messages) + +# Use LiteLLM like this +import litellm +... +response = litellm.completion(model="claude-3", messages=messages) +# or +response = await litellm.acompletion(model="claude-3", messages=messages) +``` +
+ ### LlamaIndex 🦙 (Coming Soon) @@ -261,4 +290,4 @@ AgentOps is designed to make agent observability, testing, and monitoring easy. Check out our growth in the community: -Logo \ No newline at end of file +Logo