Release 0.5.0
Features
AzureAIDirect
orchestrator
Allows pointing agents directly (no orchestrators involved) to any LLM deployed in an Azure Machine Learning workspace (e.g., Llama-2 or Mistral models).
AzureOpenAIDirect
orchestrator
Allows pointing agents directly (no orchestrators involved) to any LLM deployed in an Azure OpenAI deployment.
Override LLM parameters in completion requests
A new section is available in the completion requests that allows direct overrides of LLM parameters (e.g., top_p
, temperature
, and logprobs
for GPT).
RBAC Roles
RBAC roles (Reader
, Contributor
and User Access Administrator
) are now activated on the Management API, Core API, and Agent Factory API.
Vectorization
- Improved validation of vectorization requests (rejecting immediately requests for file types that are not supported).
- Stop vectorization request processing after N failed attempts at any given step.
- Dynamic pace of processing in vectorization worker.
- Add custom metadata to a vectorization request.
Zero trust - removing dependencies on API keys
The following components have now Entra ID managed identity-based authentication support:
- Vectorization content sources
- Resource providers
- Azure AI Search
- Authorization store and API
- Azure AI Content Safety
The following components are getting Entra ID managed identity-based authentication support in the next release:
- Azure CosmosDB service
- Azure OpenAI in LangChain
AzureAIDirect
orchestratorAzureOpenAIDirect
orchestrator
Management Portal & API Updates
Data Sources
- Data Sources consolidate Vectorization Content Source Profiles, Text Partitioning Profiles, and Text Embedding Profiles
- Users simply need to create a Data Source and select a target Azure AI Search Index to run end-to-end Vectorization from the Management Portal
- Content Source Profiles, Text Partitioning Profiles, and Text Embedding Profiles will remain available for more advanced use cases
Configuration Management
- Management Portal automatically configures Azure App Configuration keys and Azure Key Vault secrets for new Data Sources
- Management API enables management of all Azure App Configuration keys and Azure Key Vault secrets
API Changes
- Agents
- Core API
- Session-less Completion: Removal of
X-AGENT-HINT
header & passing agent name in the JSON body
- Session-less Completion: Removal of
- Vectorization path casing