Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky test of IndexShardTests.testRestoreLocalHistoryFromTranslogOnPromotion #11487

Merged
merged 1 commit into from
Dec 14, 2023

Conversation

dhwanilpatel
Copy link
Contributor

@dhwanilpatel dhwanilpatel commented Dec 6, 2023

Description

Fix flaky test of IndexShardTests.testRestoreLocalHistoryFromTranslogOnPromotion

Reason of flakyness:

  • We perform doc ingestion and update existing doc randomly.
  • After that we will generate random no between -1 to max_seqNo, and use it as maxSeqNoOfUpdatesOrDelete on replica operation.
  • Here random number should be generated between -1 to maxSeqNoOfUpdatesOrDelete as in first step docs are getting overridden randomly so max_seq no can be higher than maxSeqNoOfUpdatesOrDelete. If generated random number is generated higher than maxSeqNoOfUpdatesOrDelete then it will be updated during performing replica operation and fail the assertion.

Fix:

  • Generate random number during replica operation between -1 to maxSeqNoOfUpdatesOrDelete.

Testing

  • Test is passing with below seed for which it was failing.
    ./gradlew ':server:test' --tests "org.opensearch.index.shard.IndexShardTests.testRestoreLocalHistoryFromTranslogOnPromotion" -Dtests.seed=2A0B8EBB6B3C284B -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=sq-AL -Dtests.timezone=Pacific/Apia

Related Issues

Resolves #6873

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Failing checks are inspected and point to the corresponding known issue(s) (See: Troubleshooting Failing Builds)
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)
  • Public documentation issue/PR created

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@github-actions github-actions bot added the flaky-test Random test failure that succeeds on second run label Dec 6, 2023
Copy link
Contributor

github-actions bot commented Dec 6, 2023

Compatibility status:

Checks if related components are compatible with change a11e38b

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/performance-analyzer.git]

Copy link
Contributor

github-actions bot commented Dec 6, 2023

✅ Gradle check result for a11e38b: SUCCESS

Copy link

codecov bot commented Dec 6, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (f7f3500) 71.37% compared to head (a11e38b) 71.39%.
Report is 2 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #11487      +/-   ##
============================================
+ Coverage     71.37%   71.39%   +0.02%     
+ Complexity    59113    59089      -24     
============================================
  Files          4893     4893              
  Lines        277831   277831              
  Branches      40367    40367              
============================================
+ Hits         198288   198347      +59     
+ Misses        63042    62999      -43     
+ Partials      16501    16485      -16     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@peternied peternied left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nicely done!

@peternied peternied merged commit 332f4c5 into opensearch-project:main Dec 14, 2023
73 of 135 checks passed
@peternied peternied added the backport 2.x Backport to 2.x branch label Dec 14, 2023
opensearch-trigger-bot bot pushed a commit that referenced this pull request Dec 14, 2023
…OnPromotion (#11487)

Signed-off-by: Dhwanil Patel <[email protected]>
(cherry picked from commit 332f4c5)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
peternied pushed a commit that referenced this pull request Dec 15, 2023
…OnPromotion (#11487) (#11623)

(cherry picked from commit 332f4c5)

Signed-off-by: Dhwanil Patel <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
rayshrey pushed a commit to rayshrey/OpenSearch that referenced this pull request Mar 18, 2024
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch bug Something isn't working distributed framework flaky-test Random test failure that succeeds on second run skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Flaky Test IndexShardTests.testRestoreLocalHistoryFromTranslogOnPromotion
3 participants