Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix NODE_SEARCH_CACHE_SIZE_SETTING initialization for TIERED_REMOTE_INDEX_SETTING feature #15076

Merged
merged 1 commit into from
Aug 5, 2024

Conversation

neetikasinghal
Copy link
Contributor

@neetikasinghal neetikasinghal commented Aug 2, 2024

Description

This pr fixes NODE_SEARCH_CACHE_SIZE_SETTING initialization for TIERED_REMOTE_INDEX_SETTING feature.
As per current logic, if TIERED_REMOTE_INDEX_SETTING feature flag is enabled, the cache size will always be initialized to 80% irrespective of its search role.

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@neetikasinghal
Copy link
Contributor Author

@andrross @dblock please review!

Copy link
Contributor

github-actions bot commented Aug 2, 2024

❌ Gradle check result for f5cf1c2: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

github-actions bot commented Aug 2, 2024

❌ Gradle check result for 379f283: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@dblock
Copy link
Member

dblock commented Aug 2, 2024

So this was just a mistake, cache is used by search nodes and therefore should be initialized at 80%?

Copy link
Contributor

github-actions bot commented Aug 2, 2024

❌ Gradle check result for 379f283: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@neetikasinghal
Copy link
Contributor Author

So this was just a mistake, cache is used by search nodes and therefore should be initialized at 80%?

for dedicated search nodes, yes thats the default.

@jed326
Copy link
Collaborator

jed326 commented Aug 2, 2024

@neetikasinghal can you please rebase? d4e7766 should fix the build failures.

Copy link
Contributor

github-actions bot commented Aug 2, 2024

❌ Gradle check result for ac06640: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@jed326
Copy link
Collaborator

jed326 commented Aug 2, 2024

@neetikasinghal I think this failure might be related to your change

SettingsException[Unable to initialize the search-data node: Missing value for configuration node.search.cache.size]
	at __randomizedtesting.SeedInfo.seed([72A1176649C8BC87:96BAE4D48127ADAC]:0)
	at app//org.opensearch.node.Node.initializeFileCache(Node.java:2053)
	at app//org.opensearch.node.Node.<init>(Node.java:746)
	at app//org.opensearch.node.MockNode.<init>(MockNode.java:120)
	at app//org.opensearch.node.MockNode.<init>(MockNode.java:108)

@neetikasinghal
Copy link
Contributor Author

@neetikasinghal I think this failure might be related to your change

SettingsException[Unable to initialize the search-data node: Missing value for configuration node.search.cache.size]
	at __randomizedtesting.SeedInfo.seed([72A1176649C8BC87:96BAE4D48127ADAC]:0)
	at app//org.opensearch.node.Node.initializeFileCache(Node.java:2053)
	at app//org.opensearch.node.Node.<init>(Node.java:746)
	at app//org.opensearch.node.MockNode.<init>(MockNode.java:120)
	at app//org.opensearch.node.MockNode.<init>(MockNode.java:108)

looks like this test needs an update, let me update it.

Copy link
Contributor

github-actions bot commented Aug 2, 2024

✅ Gradle check result for e235bbf: SUCCESS

Copy link

codecov bot commented Aug 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.80%. Comparing base (48634bd) to head (f3f4201).
Report is 3 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #15076      +/-   ##
============================================
- Coverage     71.82%   71.80%   -0.03%     
- Complexity    62778    62801      +23     
============================================
  Files          5169     5169              
  Lines        294646   294664      +18     
  Branches      42610    42615       +5     
============================================
- Hits         211644   211576      -68     
- Misses        65573    65692     +119     
+ Partials      17429    17396      -33     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

github-actions bot commented Aug 2, 2024

✅ Gradle check result for f3f4201: SUCCESS

@jed326 jed326 merged commit f0ef14d into opensearch-project:main Aug 5, 2024
35 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Aug 5, 2024
…NDEX_SETTING feature (#15076)

Signed-off-by: Neetika Singhal <[email protected]>
(cherry picked from commit f0ef14d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
jed326 pushed a commit that referenced this pull request Aug 5, 2024
…NDEX_SETTING feature (#15076) (#15116)

(cherry picked from commit f0ef14d)

Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@neetikasinghal neetikasinghal deleted the fix-node-setting branch August 6, 2024 17:49
harshavamsi pushed a commit to harshavamsi/OpenSearch that referenced this pull request Aug 20, 2024
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
akolarkunnu pushed a commit to akolarkunnu/OpenSearch that referenced this pull request Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants