Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Obs AI Assistant] Increase no of max function calls to 5 #175588

Merged
merged 2 commits into from
Jan 26, 2024

Conversation

dgieselaar
Copy link
Member

@dgieselaar dgieselaar commented Jan 25, 2024

The function limit of 3 is too low, it runs into issues w/ ES|QL query generation if the get_dataset_info and execute_query functions are used.

@apmmachine
Copy link
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • /oblt-deploy-serverless : Deploy a serverless Kibana instance using the Observability test environments.
  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@kibana-ci
Copy link
Collaborator

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@@ -147,7 +147,7 @@ export class ObservabilityAIAssistantClient {

let numFunctionsCalled: number = 0;

const MAX_FUNCTION_CALLS = 3;
const MAX_FUNCTION_CALLS = 5;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wondering if perhaps we should make this a Kibana config?
Or is it perhaps worse to go up to 10? No limit is bad, but how confident are we that the machine is "failing" if it makes it up to 5, compared to 10?

Specially if we add new functions that may play well together, this might be hard to catch. Unless we have some telemetry about this happening?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

10 is a lot. I hesitate to add more config. Let's see if we get reports about this.

@dgieselaar dgieselaar merged commit beff74e into elastic:main Jan 26, 2024
19 checks passed
@dgieselaar dgieselaar deleted the obs-ai-assistant-fn-limit branch January 26, 2024 09:17
@kibanamachine
Copy link
Contributor

💔 All backports failed

Status Branch Result
8.12 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 175588

Questions ?

Please refer to the Backport tool documentation

@dgieselaar
Copy link
Member Author

💚 All backports created successfully

Status Branch Result
8.12

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

dgieselaar added a commit to dgieselaar/kibana that referenced this pull request Jan 26, 2024
…5588)

The function limit of 3 is too low, it runs into issues w/ ES|QL query
generation if the `get_dataset_info` and `execute_query` functions are
used.

(cherry picked from commit beff74e)
dgieselaar added a commit that referenced this pull request Jan 26, 2024
…5588) (#175668)

# Backport

This will backport the following commits from `main` to `8.12`:
- [[Obs AI Assistant] Increase no of max function calls to 5
(#175588)](#175588)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Dario
Gieselaar","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-01-26T09:17:36Z","message":"[Obs
AI Assistant] Increase no of max function calls to 5 (#175588)\n\nThe
function limit of 3 is too low, it runs into issues w/ ES|QL
query\r\ngeneration if the `get_dataset_info` and `execute_query`
functions
are\r\nused.","sha":"beff74e19e94c7d3c609a2be0cb1d4b2f28da043","branchLabelMapping":{"^v8.13.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:fix","v8.12.1","v8.13.0"],"number":175588,"url":"https://github.com/elastic/kibana/pull/175588","mergeCommit":{"message":"[Obs
AI Assistant] Increase no of max function calls to 5 (#175588)\n\nThe
function limit of 3 is too low, it runs into issues w/ ES|QL
query\r\ngeneration if the `get_dataset_info` and `execute_query`
functions
are\r\nused.","sha":"beff74e19e94c7d3c609a2be0cb1d4b2f28da043"}},"sourceBranch":"main","suggestedTargetBranches":["8.12"],"targetPullRequestStates":[{"branch":"8.12","label":"v8.12.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.13.0","labelRegex":"^v8.13.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/175588","number":175588,"mergeCommit":{"message":"[Obs
AI Assistant] Increase no of max function calls to 5 (#175588)\n\nThe
function limit of 3 is too low, it runs into issues w/ ES|QL
query\r\ngeneration if the `get_dataset_info` and `execute_query`
functions
are\r\nused.","sha":"beff74e19e94c7d3c609a2be0cb1d4b2f28da043"}}]}]
BACKPORT-->
CoenWarmer pushed a commit to CoenWarmer/kibana that referenced this pull request Feb 15, 2024
…5588)

The function limit of 3 is too low, it runs into issues w/ ES|QL query
generation if the `get_dataset_info` and `execute_query` functions are
used.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants