release-genaicommons-1.3.0
tswarmerdam-mx
released this
19 Sep 14:32
·
62 commits
to main
since this release
We have added operations for GenAI connector developers to be able to store token usage data for monitoring purposes. This is a new requirement for GenAI connectors that adhere to the principles of GenAI Commons. For now, this is only applicable for chat completions (text generation) and embeddings operations.
If you are working on a customer app and want to show charts in your app at runtime for this usage data, you can use the page and logic from the Conversational UI module. To control whether usage data is stored, refer to the constant StoreUsageMetrics.
Additionally, we added a cleanup process that can be controlled using the constant Usage_CleanUpAfterDays (see in-model documentation for more details).