Adding lucene snapshot to the ci staging repository

[peterzhuamazon]

Description

Adding lucene snapshot to the ci staging repository

Old Location: https://d1nvenhzbhpy0q.cloudfront.net/snapshots/lucene/
New Location: https://ci.opensearch.org/ci/dbc/snapshots/lucene/

Related Issues

Resolves #[Issue number to be closed when this PR is merged]
opensearch-project/opensearch-build#3874

Check List

New functionality includes testing.
All tests pass
New functionality has been documented.
New functionality has javadoc added
Commit changes are listed out in CHANGELOG.md file (See: Changelog)

• Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[github-actions]

Compatibility status:

Checks if related components are compatible with change b8e2a61

Incompatible components

Incompatible components: [https://github.com/opensearch-project/performance-analyzer.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/sql.git]

[peterzhuamazon]

This change only change github actions, does not break PA in the commit.

[peternied]

Thanks @peterzhuamazon - this looks good. Do you have an example of this workflow executing?

[github-actions]

❕ Gradle check result for e9acc5f: UNSTABLE

• TEST FAILURES:

      1 org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled
      1 org.opensearch.search.SearchWeightedRoutingIT.testMultiGetWithNetworkDisruption_FailOpenEnabled

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (0a9dfec) 71.15% compared to head (b8e2a61) 71.12%.
Report is 39 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main   #11241      +/-   ##
============================================
- Coverage     71.15%   71.12%   -0.03%     
+ Complexity    58787    58719      -68     
============================================
  Files          4883     4883              
  Lines        277145   277145              
  Branches      40284    40284              
============================================
- Hits         197196   197117      -79     
- Misses        63512    63562      +50     
- Partials      16437    16466      +29     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[peterzhuamazon]

Thanks @peterzhuamazon - this looks good. Do you have an example of this workflow executing?

Here: https://github.com/peterzhuamazon/OpenSearch/actions/runs/6883604580/job/18724492816

[peterzhuamazon]

Hi @peternied @mch2 ,

Add some changes:

1. Add test results
2. Add old snapshot push back for now.

Please review if you have time.
Thanks.

[github-actions]

❕ Gradle check result for b8e2a61: UNSTABLE

• TEST FAILURES:

      1 org.opensearch.repositories.azure.AzureBlobStoreRepositoryTests.testMultipleSnapshotAndRollback

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[peternied]

Thanks for the update @peterzhuamazon could you please:

• Provide a new example of the workflow executing?
• For all the build, please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[bbarani]

Thanks for the update @peterzhuamazon could you please:

• Provide a new example of the workflow executing?
• For all the build, please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

For # 1 , here's the link to GitHub action: https://github.com/peterzhuamazon/OpenSearch/actions/runs/6883604580/job/18724492816

For # 2 , @peterzhuamazon will look in to the retries and create new issues if needed.

[peterzhuamazon]

Hi @peternied @mch2,

Here are existing issues I found:

• [BUG] org.opensearch.search.SearchWeightedRoutingIT.testShardRoutingWithNetworkDisruption_FailOpenEnabled is flaky #10673
• [BUG] org.opensearch.search.SearchWeightedRoutingIT.testMultiGetWithNetworkDisruption_FailOpenEnabled is flaky #10755
• Better visibility into test failures over time #11217

Thanks.

[peterzhuamazon]

Hi @peternied @mch2 can we please approve this PR to move forward?
Thanks.

[bbarani]

@peternied @mch2 @reta can you please review this PR and provide your feedback / approval?

[mch2]

This LGTM, thanks @peterzhuamazon.

Once this is merged I'll trigger a build and test at both endpoints before updating version.properties