diff --git a/.doctrees/apis/components/components.model_client.anthropic_client.doctree b/.doctrees/apis/components/components.model_client.anthropic_client.doctree index a9b9bbbc..86ff9a62 100644 Binary files a/.doctrees/apis/components/components.model_client.anthropic_client.doctree and b/.doctrees/apis/components/components.model_client.anthropic_client.doctree differ diff --git a/.doctrees/apis/components/components.model_client.bedrock_client.doctree b/.doctrees/apis/components/components.model_client.bedrock_client.doctree index 35302e1c..f79d16c0 100644 Binary files a/.doctrees/apis/components/components.model_client.bedrock_client.doctree and b/.doctrees/apis/components/components.model_client.bedrock_client.doctree differ diff --git a/.doctrees/apis/components/components.model_client.google_client.doctree b/.doctrees/apis/components/components.model_client.google_client.doctree index d642cdce..44d93d82 100644 Binary files a/.doctrees/apis/components/components.model_client.google_client.doctree and b/.doctrees/apis/components/components.model_client.google_client.doctree differ diff --git a/.doctrees/apis/datasets/datasets.types.doctree b/.doctrees/apis/datasets/datasets.types.doctree index 92da8a6e..841cefad 100644 Binary files a/.doctrees/apis/datasets/datasets.types.doctree and b/.doctrees/apis/datasets/datasets.types.doctree differ diff --git a/.doctrees/apis/datasets/index.doctree b/.doctrees/apis/datasets/index.doctree index ee878786..8d2e29f0 100644 Binary files a/.doctrees/apis/datasets/index.doctree and b/.doctrees/apis/datasets/index.doctree differ diff --git a/.doctrees/environment.pickle b/.doctrees/environment.pickle index 7ef4f65d..00fbe670 100644 Binary files a/.doctrees/environment.pickle and b/.doctrees/environment.pickle differ diff --git a/_modules/components/model_client/anthropic_client.html b/_modules/components/model_client/anthropic_client.html index fa916071..63a1a40a 100644 --- a/_modules/components/model_client/anthropic_client.html +++ b/_modules/components/model_client/anthropic_client.html @@ -494,7 +494,10 @@
GroqAPIClient,
OpenAIClient,
GoogleGenAIClient,
- OllamaClient
+ OllamaClient,
)
diff --git a/_static/images/multi-providers.png b/_static/images/multi-providers.png
new file mode 100644
index 00000000..291b69f3
Binary files /dev/null and b/_static/images/multi-providers.png differ
diff --git a/apis/components/components.model_client.anthropic_client.html b/apis/components/components.model_client.anthropic_client.html
index f74a5078..6724ab60 100644
--- a/apis/components/components.model_client.anthropic_client.html
+++ b/apis/components/components.model_client.anthropic_client.html
@@ -612,7 +612,9 @@
Bases: ModelClient
A component wrapper for the Anthropic API client.
Visit https://docs.anthropic.com/en/docs/intro-to-claude for more api details.
-Ensure “max_tokens” are set.
+Note:
+As antropic API needs users to set max_tokens, we set up a default value of 512 for the max_tokens. +You can override this value by passing the max_tokens in the model_kwargs.
Reference: 8/1/2024 - https://docs.anthropic.com/en/docs/about-claude/models
Bases: ModelClient
A component wrapper for the Bedrock API client. -Visit https://docs.aws.amazon.com/bedrock/latest/APIReference/welcome.html for more api details.
+A component wrapper for the Bedrock API client.
+Note:
+This client needs a lot more work to be fully functional. +(1) Setup the AWS credentials. +(2) Access to the modelId. +(3) Convert the modelId to standard model.
+To setup the AWS credentials, follow the instructions here: +https://docs.aws.amazon.com/bedrock/latest/userguide/getting-started.html
+Additionally, this medium article is a good reference: +https://medium.com/@harangpeter/setting-up-aws-bedrock-for-api-based-text-inference-dc25ab2b216b
+Visit https://docs.aws.amazon.com/bedrock/latest/APIReference/welcome.html for more api details.
+ +BedrockAPIClient.init_async_client()
BedrockAPIClient.parse_chat_completion()
BedrockAPIClient.track_completion_usage()
BedrockAPIClient.list_models()
BedrockAPIClient.convert_inputs_to_api_kwargs()
BedrockAPIClient.call()
BedrockAPIClient.acall()
A component wrapper for the Google GenAI API client.
Visit https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/inference for more api details.
Info: 8/1/2024 -Tested: gemini-1.0-pro, gemini-1.5-pro-latest -class UsageMetadata(proto.Message):
--+Tested: gemini-1.0-pro, gemini-1.5-pro-latest +-
-- prompt_token_count: int = proto.Field(
- -
proto.INT32, -number=1,
-) -cached_content_token_count: int = proto.Field(
---proto.INT32, -number=4,
-) -candidates_token_count: int = proto.Field(
---proto.INT32, -number=2,
-) -total_token_count: int = proto.Field(
---proto.INT32, -number=3,
-)
-
class UsageMetadata(proto.Message):
+
+ prompt_token_count: int = proto.Field(
+ proto.INT32,
+ number=1,
+ )
+ cached_content_token_count: int = proto.Field(
+ proto.INT32,
+ number=4,
+ )
+ candidates_token_count: int = proto.Field(
+ proto.INT32,
+ number=2,
+ )
+ total_token_count: int = proto.Field(
+ proto.INT32,
+ number=3,
+ )
+
BedrockAPIClient.init_async_client()
BedrockAPIClient.parse_chat_completion()
BedrockAPIClient.track_completion_usage()
BedrockAPIClient.list_models()
BedrockAPIClient.convert_inputs_to_api_kwargs()
BedrockAPIClient.call()
BedrockAPIClient.acall()
Bases: DataClass
A common dataclass for representing examples in a dataset.
Bases: DataClass
A common dataclass for representing examples in a dataset.
Bases: Example
A dataclass for representing examples in the HotPotQA dataset.
Bases: BaseData
A dataclass for representing examples in the TREC dataset.
Bases: DataClass
A common dataclass for representing examples in a dataset.
Bases: Example
A dataclass for representing examples in the HotPotQA dataset.
Bases: BaseData
A dataclass for representing examples in the TREC dataset.