Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Backport 2.x] Add getter for path field in NestedQueryBuilder #11657

Merged

Conversation

psmagin
Copy link
Contributor

@psmagin psmagin commented Dec 20, 2023

Backport 7b7ca98 from #4636.

@psmagin psmagin changed the title Add getter for path field in NestedQueryBuilder (#4636) [Backport 2.x] Add getter for path field in NestedQueryBuilder Dec 20, 2023
Copy link
Contributor

github-actions bot commented Dec 20, 2023

Compatibility status:

Checks if related components are compatible with change dcfd011

Incompatible components

Incompatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/sql.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/security.git]

Copy link
Contributor

❕ Gradle check result for aa0bdf0: UNSTABLE

  • TEST FAILURES:
      1 org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

Copy link

codecov bot commented Dec 20, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (a93e86c) 71.23% compared to head (dcfd011) 71.13%.

Additional details and impacted files
@@             Coverage Diff              @@
##                2.x   #11657      +/-   ##
============================================
- Coverage     71.23%   71.13%   -0.10%     
+ Complexity    59487    59370     -117     
============================================
  Files          4891     4891              
  Lines        279940   279941       +1     
  Branches      41055    41055              
============================================
- Hits         199404   199128     -276     
- Misses        63673    63930     +257     
- Partials      16863    16883      +20     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@psmagin
Copy link
Contributor Author

psmagin commented Jan 10, 2024

@dblock, please review this backport. You had requested it some time ago.

Copy link
Contributor

❌ Gradle check result for 11ebf3b: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@dblock
Copy link
Member

dblock commented Jan 10, 2024

@psmagin check out the gradle failures? rebase?

@psmagin
Copy link
Contributor Author

psmagin commented Jan 11, 2024

@psmagin check out the gradle failures? rebase?

There is something with test that has no relation to my changes. Bug for this test was already created: #9191
org.opensearch.remotestore.RemoteIndexPrimaryRelocationIT.testPrimaryRelocationWhileIndexing

java.lang.IllegalStateException: Error while downloading cluster metadata - manifest__9223372036854775806__9223372036854775782__P__9223370331957203206__1
        at org.opensearch.gateway.remote.RemoteClusterStateService.fetchRemoteClusterMetadataManifest(RemoteClusterStateService.java:1106)
        at org.opensearch.gateway.remote.RemoteClusterStateService.lambda$getLatestClusterMetadataManifest$11(RemoteClusterStateService.java:881)
        at java.****/java.util.Optional.map(Optional.java:260)
        at org.opensearch.gateway.remote.RemoteClusterStateService.getLatestClusterMetadataManifest(RemoteClusterStateService.java:881)
        at org.opensearch.remotestore.RemoteStoreClusterStateRestoreIT.lambda$validateCurrentMetadata$3(RemoteStoreClusterStateRestoreIT.java:313)
        at org.opensearch.test.OpenSearchTestCase.assertBusy(OpenSearchTestCase.java:1077)
        at org.opensearch.test.OpenSearchTestCase.assertBusy(OpenSearchTestCase.java:1062)
        at org.opensearch.remotestore.RemoteStoreClusterStateRestoreIT.validateCurrentMetadata(RemoteStoreClusterStateRestoreIT.java:312)
        at org.opensearch.remotestore.RemoteStoreClusterStateRestoreIT.testFullClusterRestoreGlobalMetadata(RemoteStoreClusterStateRestoreIT.java:377)

        Caused by:
        org.opensearch.gateway.CorruptStateException: org.apache.lucene.index.CorruptIndexException: misplaced codec footer (file truncated?): length=0 but footerLength==16 (resource=ChecksumBlobStoreFormat.readBlob(blob="manifest__9223372036854775806__9223372036854775782__P__9223370331957203206__1"))
            at app//org.opensearch.repositories.blobstore.ChecksumBlobStoreFormat.deserialize(ChecksumBlobStoreFormat.java:158)
            at app//org.opensearch.repositories.blobstore.ChecksumBlobStoreFormat.read(ChecksumBlobStoreFormat.java:129)
            at app//org.opensearch.gateway.remote.RemoteClusterStateService.fetchRemoteClusterMetadataManifest(RemoteClusterStateService.java:1100)
            ... 8 more

            Caused by:
            org.apache.lucene.index.CorruptIndexException: misplaced codec footer (file truncated?): length=0 but footerLength==16 (resource=ChecksumBlobStoreFormat.readBlob(blob="manifest__9223372036854775806__9223372036854775782__P__9223370331957203206__1"))
                at app//org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:615)
                at app//org.opensearch.repositories.blobstore.ChecksumBlobStoreFormat.deserialize(ChecksumBlobStoreFormat.java:142)
                ... 10 more

    ClusterBlockException[blocked by: [FORBIDDEN/6/cluster read-only (api)];]
        at app//org.opensearch.cluster.block.ClusterBlocks.globalBlockedException(ClusterBlocks.java:205)
        at app//org.opensearch.action.admin.indices.datastream.DeleteDataStreamAction$TransportAction.checkBlock(DeleteDataStreamAction.java:280)
        at app//org.opensearch.action.admin.indices.datastream.DeleteDataStreamAction$TransportAction.checkBlock(DeleteDataStreamAction.java:172)
        at app//org.opensearch.action.support.clustermanager.TransportClusterManagerNodeAction$AsyncSingleAction.doStart(TransportClusterManagerNodeAction.java:237)
        at app//org.opensearch.action.support.clustermanager.TransportClusterManagerNodeAction$AsyncSingleAction.tryAction(TransportClusterManagerNodeAction.java:206)
        at app//org.opensearch.action.support.RetryableAction$1.doRun(RetryableAction.java:139)
        at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52)
        at app//org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:343)
        at app//org.opensearch.action.support.RetryableAction.run(RetryableAction.java:117)
        at app//org.opensearch.action.support.clustermanager.TransportClusterManagerNodeAction.doExecute(TransportClusterManagerNodeAction.java:167)
        at app//org.opensearch.action.support.clustermanager.TransportClusterManagerNodeAction.doExecute(TransportClusterManagerNodeAction.java:79)
        at app//org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:218)
        at app//org.opensearch.action.support.TransportAction.execute(TransportAction.java:188)
        at app//org.opensearch.action.support.TransportAction.execute(TransportAction.java:107)
        at app//org.opensearch.client.node.NodeClient.executeLocally(NodeClient.java:110)
        at app//org.opensearch.client.node.NodeClient.doExecute(NodeClient.java:97)
        at app//org.opensearch.client.support.AbstractClient.execute(AbstractClient.java:476)
        at app//org.opensearch.client.support.AbstractClient.execute(AbstractClient.java:463)
        at app//org.opensearch.client.support.AbstractClient$IndicesAdmin.execute(AbstractClient.java:1528)
        at app//org.opensearch.client.support.AbstractClient$IndicesAdmin.deleteDataStream(AbstractClient.java:2051)
        at app//org.opensearch.test.TestCluster.wipeAllDataStreams(TestCluster.java:166)
        at app//org.opensearch.test.TestCluster.wipe(TestCluster.java:91)
        at app//org.opensearch.test.OpenSearchIntegTestCase.afterInternal(OpenSearchIntegTestCase.java:623)
        at app//org.opensearch.test.OpenSearchIntegTestCase.cleanUpCluster(OpenSearchIntegTestCase.java:2418)
        at java.****@21.0.1/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
        at java.****@21.0.1/java.lang.reflect.Method.invoke(Method.java:580)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
        at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
        at app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
        at app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
        at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
        at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.****@21.0.1/java.lang.Thread.run(Thread.java:1583)
  2> NOTE: leaving temporary files on disk at: /var/jenkins/workspace/gradle-check/search/server/build/testrun/internalClusterTest/temp/org.opensearch.remotestore.RemoteStoreClusterStateRestoreIT_DF1BDD8DE1BB059D-001
  2> NOTE: test params are: codec=Asserting(Lucene95): {index_uuid=Lucene90, type=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=421, maxMBSortInHeap=6.6678418302854086, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=tr-TR, timezone=Europe/Podgorica
  2> NOTE: Linux 5.15.0-1048-aws amd64/Eclipse Adoptium 21.0.1 (64-bit)/cpus=32,threads=1,free=619790648,total=1361051648
  2> NOTE: All tests run in this JVM: [ClusterAllocationExplainIT, RemoteSplitIndexIT, IndicesSegmentsBlocksIT, GetTermVectorsIT, SpecificClusterManagerNodesIT, TemplateUpgradeServiceIT, ClusterManagerTaskThrottlingIT, NodeRepurposeCommandIT, SegmentReplicationPressureIT, PeerRecoveryRetentionLeaseCreationIT, PreBuiltAnalyzerIntegrationIT, SegmentReplicationBaseIT, CloseWhileRelocatingShardsIT, PersistentTasksExecutorIT, RemoteStoreClusterStateRestoreIT]

@psmagin
Copy link
Contributor Author

psmagin commented Jan 12, 2024

@deshsidd, @dblock. @kkmr, thank you for approvals.
Could you merge the PR?

@deshsidd
Copy link
Contributor

Looks like a build is now failing. Please take a look @psmagin

@deshsidd
Copy link
Contributor

Looks like the following test is failing : org.opensearch.remotestore.RemoteStoreClusterStateRestoreIT.testFullClusterRestoreGlobalMetadata

Most likely a transient failure. Maybe try re-triggerring the build with empty commit.

Copy link
Contributor

❕ Gradle check result for dcfd011: UNSTABLE

  • TEST FAILURES:
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testRefreshAfterCommit
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testAfterRefresh
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testAfterMultipleCommits
      1 org.opensearch.index.shard.RemoteStoreRefreshListenerTests.testAfterCommit

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

@psmagin
Copy link
Contributor Author

psmagin commented Jan 22, 2024

@deshsidd, @dblock, Gradle is not not failing. There are some tests failures, but I can see that these test are failing in other PRs also. So, they are not related to this backport.

@kotwanikunal
Copy link
Member

Looks like the approval workflow is stuck. @peternied Can you please help here?

@kotwanikunal kotwanikunal merged commit f588880 into opensearch-project:2.x Jan 24, 2024
29 checks passed
@kotwanikunal
Copy link
Member

Looks like the approval workflow is stuck. @peternied Can you please help here?

#11864

@psmagin psmagin deleted the backport/backport-4636-to-2.x branch January 31, 2024 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants