Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ES|QL fix telemetry tests (usage stats) after promoting CATEGORIZE #117878

Merged

Conversation

luigidellaquila
Copy link
Contributor

@luigidellaquila luigidellaquila commented Dec 3, 2024

After promoting CATEGORIZE function to non-snapshot, release tests started failing because we did not account for that function in the usage stats.

Fixes: #117862
Fixes: #117905
Fixes: #117907
Fixes: #117908

@luigidellaquila luigidellaquila added >non-issue auto-backport Automatically create backport pull requests when merged :Analytics/ES|QL AKA ESQL v8.18.0 labels Dec 3, 2024
@elasticsearchmachine elasticsearchmachine added v9.0.0 Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) labels Dec 3, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@@ -163,4 +163,4 @@ setup:
- match: {esql.functions.cos: $functions_cos}
- gt: {esql.functions.to_long: $functions_to_long}
- match: {esql.functions.coalesce: $functions_coalesce}
- length: {esql.functions: 118} # check the "sister" test above for a likely update to the same esql.functions length check
- length: {esql.functions: 119} # check the "sister" test above for a likely update to the same esql.functions length check
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't the other test be changed as well?

Also, I am not clear about the "promotion" of categorize. Looking at EsqlCapabilities I see it's still a snapshot only feature test-wise.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, if this is about snapshot/non-snapshot thingies, shouldn't the PR run with test-release label?
Even the issue it's trying to fix (#117862) comes from test-release CI runs.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see it's still a snapshot only feature test-wise.
It's going to be un-snapshotted soon!

Thanks for pointing out the test-release label, I was unaware of that one.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The other test is good because the function existed already (but only in snapshot).

The promotion happened in EsqlFunctionRegistry, I think the capabilities should be changed as well. Since we are on it, let me do it now

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, the un-snapshotting of the capability in #117881 should make sure that the CATEGORIZE test also run on release tests. Thanks for looking into this Luigi!

Copy link
Contributor

@alex-spies alex-spies left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@alex-spies
Copy link
Contributor

alex-spies commented Dec 3, 2024

Hey, I just realized - here we moved CATEGORIZE into the non-snapshot functions but didn't make it actually available outside of SNAPSHOT builds.

A more correct solution could be to revert just this change, and move it out of the SNAPSHOT functions once we actually un-snapshot it.

Update: Actually, let me double check that. I think the change to the EsqlFunctionRegistry already un-snapshotted CATEGORIZE and only the capability doesn't reflect that.

Update 2: Yes, that's the case. This confirms the PR is doing the right thing!

@luigidellaquila luigidellaquila added the test-release Trigger CI checks against release build label Dec 3, 2024
Copy link
Contributor

@astefan astefan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM if tests pass.

Let's be reasonable about test-release label: we are doing our best to prove our own changes pass this label's test, if there are other issues unrelated to ES|QL with test-release, ideally and if we have time we can create GH issue for the appropriate teams, otherwise it's ok to merge imo.

@luigidellaquila luigidellaquila enabled auto-merge (squash) December 3, 2024 15:36
@luigidellaquila luigidellaquila removed the test-release Trigger CI checks against release build label Dec 3, 2024
@luigidellaquila luigidellaquila merged commit 0a20827 into elastic:main Dec 3, 2024
15 of 16 checks passed
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 117878

@luigidellaquila
Copy link
Contributor Author

Backport #117915

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment