Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correct typo in method name #14621

Merged
merged 1 commit into from
Jul 2, 2024
Merged

Conversation

imvtsl
Copy link
Contributor

@imvtsl imvtsl commented Jul 2, 2024

Description

There is typo in 'From' part of the method name testFomXContentEmbeddedFoundParsingException in GetResultTests.java class. 'Fom' is changed to 'From'.

Related Issues

Resolves #14620

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@imvtsl
Copy link
Contributor Author

imvtsl commented Jul 2, 2024

@gaobinlong @dbwiddis @andrross
This PR is in reference to this comment in the merged PR.

@github-actions github-actions bot added bug Something isn't working Libraries Lucene Upgrades and Libraries, Any 3rd party library that Core depends on, ex: nebula; team is respo labels Jul 2, 2024
@owaiskazi19 owaiskazi19 added skip-changelog and removed bug Something isn't working Libraries Lucene Upgrades and Libraries, Any 3rd party library that Core depends on, ex: nebula; team is respo labels Jul 2, 2024
Copy link

codecov bot commented Jul 2, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.88%. Comparing base (6267e94) to head (d3a5ce5).
Report is 2 commits behind head on main.

Additional details and impacted files
@@             Coverage Diff              @@
##               main   #14621      +/-   ##
============================================
+ Coverage     71.65%   71.88%   +0.23%     
- Complexity    62272    62368      +96     
============================================
  Files          5140     5140              
  Lines        293020   293020              
  Branches      42347    42347              
============================================
+ Hits         209977   210652     +675     
+ Misses        65766    65001     -765     
- Partials      17277    17367      +90     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@andrross andrross added the backport 2.x Backport to 2.x branch label Jul 2, 2024
@andrross andrross merged commit f1f4f89 into opensearch-project:main Jul 2, 2024
61 of 63 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jul 2, 2024
Signed-off-by: vatsal <[email protected]>
(cherry picked from commit f1f4f89)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
andrross pushed a commit that referenced this pull request Jul 2, 2024
(cherry picked from commit f1f4f89)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
kaushalmahi12 pushed a commit to kaushalmahi12/OpenSearch that referenced this pull request Jul 3, 2024
kaushalmahi12 pushed a commit to kaushalmahi12/OpenSearch that referenced this pull request Jul 8, 2024
akolarkunnu pushed a commit to akolarkunnu/OpenSearch that referenced this pull request Jul 9, 2024
bharath-techie added a commit to bharath-techie/OpenSearch that referenced this pull request Jul 10, 2024
* Fix flaky test in range aggregation yaml test (opensearch-project#14486)

Signed-off-by: bowenlan-amzn <[email protected]>

* Use CODECOV_TOKEN (opensearch-project#14536)

Signed-off-by: Prudhvi Godithi <[email protected]>

* [Tiered Caching]  Moving query recomputation logic outside of write lock (opensearch-project#14187)

* Moving query recompute out of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* [Tiered Caching] Moving query recomputation logic outside of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding java doc for the completable map

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Changes to call future handler only once per key

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing spotless check

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Added changelog

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle fail

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments to refactor unit test

Signed-off-by: Sagar Upadhyaya <[email protected]>

* minor UT refactor

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Fix Flaky Test ClusterRerouteIT.testDelayWithALargeAmountOfShards (opensearch-project#14510)

Signed-off-by: kkewwei [email protected]

Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>

* Add doc for debugging rest tests (opensearch-project#14491)

* add doc for debugging rest tests

Signed-off-by: bowenlan-amzn <[email protected]>

* Update TESTING.md

Co-authored-by: Marc Handalian <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>

* Address comment

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>

* Fix flaky DefaultCacheStatsHolderTests (opensearch-project#14462)

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* [AUTO] [main] Add bwc version 2.15.1. (opensearch-project#14549)

* Add bwc version 2.15.1

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Fix auto-generated version

Signed-off-by: Andrew Ross <[email protected]>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently (opensearch-project#14550)

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Add allowlist setting for ingest-common processors (opensearch-project#14479)

Add a new static setting that lets an operator choose specific ingest
processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Fix file cache initialization (opensearch-project#14004)

* fix file cache initialization

Signed-off-by: panguixin <[email protected]>

* changelog

Signed-off-by: panguixin <[email protected]>

* add test

Signed-off-by: panguixin <[email protected]>

---------

Signed-off-by: panguixin <[email protected]>

* Add Ashish Singh as maintainer (opensearch-project#14567)

Signed-off-by: Bukhtawar Khan <[email protected]>

* Allow @internalapi annotation on classes not meant to be constructed outside of the OpenSearch core (opensearch-project#14575)

Signed-off-by: Andriy Redko <[email protected]>

* Bump com.azure:azure-storage-common from 12.21.2 to 12.25.1 in /plugins/repository-azure (opensearch-project#14517)

* Bump com.azure:azure-storage-common in /plugins/repository-azure

Bumps [com.azure:azure-storage-common](https://github.com/Azure/azure-sdk-for-java) from 12.21.2 to 12.25.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-java/releases)
- [Commits](Azure/azure-sdk-for-java@azure-storage-common_12.21.2...azure-storage-blob_12.25.1)

---
updated-dependencies:
- dependency-name: com.azure:azure-storage-common
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* Add allowlist setting for search-pipeline-common processors (opensearch-project#14562)

Add a new static setting that lets an operator choose specific search
pipeline processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

A distinct setting exists for each of request, response, and search phase
results processors.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Bump Apache Lucene to 9.11.1 (opensearch-project#14576) (opensearch-project#14581)

(cherry picked from commit 0095fd1)

Signed-off-by: Andriy Redko <[email protected]>

* Add unittests for RemoteClusterStateAttributesManager (opensearch-project#14427)

* Add unittests for RemoteClusterStateAttributesManager

Signed-off-by: Shivansh Arora <[email protected]>

* Add Ashish Singh to codeowners (opensearch-project#14592)

Signed-off-by: Ashish Singh <[email protected]>

* Add batching processor base type AbstractBatchingProcessor (opensearch-project#14554)

Signed-off-by: Liyun Xiu <[email protected]>

* Add @internalapi annotation to japicmp exclusions (opensearch-project#14597)

Signed-off-by: Andriy Redko <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is mis… (opensearch-project#14552)

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix spotless issues. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:update changelog

Signed-off-by: vatsal <[email protected]>

---------

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>

* Star tree mapping changes (opensearch-project#14605)

* Star tree mapping changes with feature flag
---------
Signed-off-by: Bharathwaj G <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>

* OnHeap Star Tree Implementation

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed major nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* includes Count Aggregator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* handling for missing doc values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressing review comments

Signed-off-by: Sarthak Aggarwal <[email protected]>

* rebasing with main

Signed-off-by: Sarthak Aggarwal <[email protected]>

* support for empty sequential doc values iterator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* min and max star tree aggregators

Signed-off-by: Sarthak Aggarwal <[email protected]>

* star tree file formats

* Star tree codec changes

Signed-off-by: Bharathwaj G <[email protected]>

* Adding tests

Signed-off-by: Bharathwaj G <[email protected]>

* Addressing comments

Signed-off-by: Bharathwaj G <[email protected]>

* addressing review comments

Signed-off-by: Bharathwaj G <[email protected]>

* Star tree merge changes

Signed-off-by: Bharathwaj G <[email protected]>

* fix annotations

* star-tree file formats reader and javadoc fixes

* read for composite index values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* doc values file format

Signed-off-by: Sarthak Aggarwal <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Prudhvi Godithi <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: panguixin <[email protected]>
Signed-off-by: Bukhtawar Khan <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Bharathwaj G <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Prudhvi Godithi <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
Co-authored-by: panguixin <[email protected]>
Co-authored-by: Bukhtawar Khan <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
bharath-techie added a commit to bharath-techie/OpenSearch that referenced this pull request Jul 11, 2024
* Fix flaky test in range aggregation yaml test (opensearch-project#14486)

Signed-off-by: bowenlan-amzn <[email protected]>

* Use CODECOV_TOKEN (opensearch-project#14536)

Signed-off-by: Prudhvi Godithi <[email protected]>

* [Tiered Caching]  Moving query recomputation logic outside of write lock (opensearch-project#14187)

* Moving query recompute out of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* [Tiered Caching] Moving query recomputation logic outside of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding java doc for the completable map

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Changes to call future handler only once per key

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing spotless check

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Added changelog

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle fail

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments to refactor unit test

Signed-off-by: Sagar Upadhyaya <[email protected]>

* minor UT refactor

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Fix Flaky Test ClusterRerouteIT.testDelayWithALargeAmountOfShards (opensearch-project#14510)

Signed-off-by: kkewwei [email protected]

Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>

* Add doc for debugging rest tests (opensearch-project#14491)

* add doc for debugging rest tests

Signed-off-by: bowenlan-amzn <[email protected]>

* Update TESTING.md

Co-authored-by: Marc Handalian <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>

* Address comment

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>

* Fix flaky DefaultCacheStatsHolderTests (opensearch-project#14462)

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* [AUTO] [main] Add bwc version 2.15.1. (opensearch-project#14549)

* Add bwc version 2.15.1

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Fix auto-generated version

Signed-off-by: Andrew Ross <[email protected]>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently (opensearch-project#14550)

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Add allowlist setting for ingest-common processors (opensearch-project#14479)

Add a new static setting that lets an operator choose specific ingest
processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Fix file cache initialization (opensearch-project#14004)

* fix file cache initialization

Signed-off-by: panguixin <[email protected]>

* changelog

Signed-off-by: panguixin <[email protected]>

* add test

Signed-off-by: panguixin <[email protected]>

---------

Signed-off-by: panguixin <[email protected]>

* Add Ashish Singh as maintainer (opensearch-project#14567)

Signed-off-by: Bukhtawar Khan <[email protected]>

* Allow @internalapi annotation on classes not meant to be constructed outside of the OpenSearch core (opensearch-project#14575)

Signed-off-by: Andriy Redko <[email protected]>

* Bump com.azure:azure-storage-common from 12.21.2 to 12.25.1 in /plugins/repository-azure (opensearch-project#14517)

* Bump com.azure:azure-storage-common in /plugins/repository-azure

Bumps [com.azure:azure-storage-common](https://github.com/Azure/azure-sdk-for-java) from 12.21.2 to 12.25.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-java/releases)
- [Commits](Azure/azure-sdk-for-java@azure-storage-common_12.21.2...azure-storage-blob_12.25.1)

---
updated-dependencies:
- dependency-name: com.azure:azure-storage-common
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* Add allowlist setting for search-pipeline-common processors (opensearch-project#14562)

Add a new static setting that lets an operator choose specific search
pipeline processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

A distinct setting exists for each of request, response, and search phase
results processors.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Bump Apache Lucene to 9.11.1 (opensearch-project#14576) (opensearch-project#14581)

(cherry picked from commit 0095fd1)

Signed-off-by: Andriy Redko <[email protected]>

* Add unittests for RemoteClusterStateAttributesManager (opensearch-project#14427)

* Add unittests for RemoteClusterStateAttributesManager

Signed-off-by: Shivansh Arora <[email protected]>

* Add Ashish Singh to codeowners (opensearch-project#14592)

Signed-off-by: Ashish Singh <[email protected]>

* Add batching processor base type AbstractBatchingProcessor (opensearch-project#14554)

Signed-off-by: Liyun Xiu <[email protected]>

* Add @internalapi annotation to japicmp exclusions (opensearch-project#14597)

Signed-off-by: Andriy Redko <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is mis… (opensearch-project#14552)

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix spotless issues. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:update changelog

Signed-off-by: vatsal <[email protected]>

---------

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>

* Star tree mapping changes (opensearch-project#14605)

* Star tree mapping changes with feature flag
---------
Signed-off-by: Bharathwaj G <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>

* OnHeap Star Tree Implementation

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed major nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* includes Count Aggregator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* handling for missing doc values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressing review comments

Signed-off-by: Sarthak Aggarwal <[email protected]>

* rebasing with main

Signed-off-by: Sarthak Aggarwal <[email protected]>

* support for empty sequential doc values iterator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* min and max star tree aggregators

Signed-off-by: Sarthak Aggarwal <[email protected]>

* star tree file formats

* Star tree codec changes

Signed-off-by: Bharathwaj G <[email protected]>

* Adding tests

Signed-off-by: Bharathwaj G <[email protected]>

* Addressing comments

Signed-off-by: Bharathwaj G <[email protected]>

* addressing review comments

Signed-off-by: Bharathwaj G <[email protected]>

* Star tree merge changes

Signed-off-by: Bharathwaj G <[email protected]>

* fix annotations

* star-tree file formats reader and javadoc fixes

* read for composite index values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* doc values file format

Signed-off-by: Sarthak Aggarwal <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Prudhvi Godithi <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: panguixin <[email protected]>
Signed-off-by: Bukhtawar Khan <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Bharathwaj G <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Prudhvi Godithi <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
Co-authored-by: panguixin <[email protected]>
Co-authored-by: Bukhtawar Khan <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
bharath-techie added a commit to bharath-techie/OpenSearch that referenced this pull request Jul 11, 2024
* Fix flaky test in range aggregation yaml test (opensearch-project#14486)

Signed-off-by: bowenlan-amzn <[email protected]>

* Use CODECOV_TOKEN (opensearch-project#14536)

Signed-off-by: Prudhvi Godithi <[email protected]>

* [Tiered Caching]  Moving query recomputation logic outside of write lock (opensearch-project#14187)

* Moving query recompute out of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* [Tiered Caching] Moving query recomputation logic outside of write lock

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding java doc for the completable map

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Changes to call future handler only once per key

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing spotless check

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Added changelog

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle fail

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comments to refactor unit test

Signed-off-by: Sagar Upadhyaya <[email protected]>

* minor UT refactor

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Fix Flaky Test ClusterRerouteIT.testDelayWithALargeAmountOfShards (opensearch-project#14510)

Signed-off-by: kkewwei [email protected]

Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>

* Add doc for debugging rest tests (opensearch-project#14491)

* add doc for debugging rest tests

Signed-off-by: bowenlan-amzn <[email protected]>

* Update TESTING.md

Co-authored-by: Marc Handalian <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>

* Address comment

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>

* Fix flaky DefaultCacheStatsHolderTests (opensearch-project#14462)

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* [AUTO] [main] Add bwc version 2.15.1. (opensearch-project#14549)

* Add bwc version 2.15.1

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Fix auto-generated version

Signed-off-by: Andrew Ross <[email protected]>

---------

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently (opensearch-project#14550)

* Fix flaky test TieredSpilloverCacheTests.testComputeIfAbsentConcurrently

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>

* Add allowlist setting for ingest-common processors (opensearch-project#14479)

Add a new static setting that lets an operator choose specific ingest
processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Fix file cache initialization (opensearch-project#14004)

* fix file cache initialization

Signed-off-by: panguixin <[email protected]>

* changelog

Signed-off-by: panguixin <[email protected]>

* add test

Signed-off-by: panguixin <[email protected]>

---------

Signed-off-by: panguixin <[email protected]>

* Add Ashish Singh as maintainer (opensearch-project#14567)

Signed-off-by: Bukhtawar Khan <[email protected]>

* Allow @internalapi annotation on classes not meant to be constructed outside of the OpenSearch core (opensearch-project#14575)

Signed-off-by: Andriy Redko <[email protected]>

* Bump com.azure:azure-storage-common from 12.21.2 to 12.25.1 in /plugins/repository-azure (opensearch-project#14517)

* Bump com.azure:azure-storage-common in /plugins/repository-azure

Bumps [com.azure:azure-storage-common](https://github.com/Azure/azure-sdk-for-java) from 12.21.2 to 12.25.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-java/releases)
- [Commits](Azure/azure-sdk-for-java@azure-storage-common_12.21.2...azure-storage-blob_12.25.1)

---
updated-dependencies:
- dependency-name: com.azure:azure-storage-common
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* Add allowlist setting for search-pipeline-common processors (opensearch-project#14562)

Add a new static setting that lets an operator choose specific search
pipeline processors to enable by name. The behavior is as follows:

- If the allowlist setting is not defined, all installed processors are
  enabled. This is the status quo.
- If the allowlist setting is defined as the empty set, then all processors
  are disabled.
- If the allowlist setting contains the names of valid processors, only those
  processors are enabled.
- If the allowlist setting contains a name of a processor that does not exist,
  then the server will fail to start with an IllegalStateException
  listing which processors were defined in the allowlist but are not
  installed.
- If the allowlist setting is changed between server restarts then any
  ingest pipeline using a now-disabled processor will fail. This is the
  same experience if a pipeline used a processor defined by a plugin but
  then that plugin were to be uninstalled across restarts.

A distinct setting exists for each of request, response, and search phase
results processors.

Related to opensearch-project#14439

Signed-off-by: Andrew Ross <[email protected]>

* Bump Apache Lucene to 9.11.1 (opensearch-project#14576) (opensearch-project#14581)

(cherry picked from commit 0095fd1)

Signed-off-by: Andriy Redko <[email protected]>

* Add unittests for RemoteClusterStateAttributesManager (opensearch-project#14427)

* Add unittests for RemoteClusterStateAttributesManager

Signed-off-by: Shivansh Arora <[email protected]>

* Add Ashish Singh to codeowners (opensearch-project#14592)

Signed-off-by: Ashish Singh <[email protected]>

* Add batching processor base type AbstractBatchingProcessor (opensearch-project#14554)

Signed-off-by: Liyun Xiu <[email protected]>

* Add @internalapi annotation to japicmp exclusions (opensearch-project#14597)

Signed-off-by: Andriy Redko <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is mis… (opensearch-project#14552)

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Parsing a GetResult returns NPE if found field is missing. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix wildcart import. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:Fix spotless issues. Signed-off-by: Vatsal <[email protected]>

Signed-off-by: vatsal <[email protected]>

* Fix issue 14519:update changelog

Signed-off-by: vatsal <[email protected]>

---------

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>

* Star tree mapping changes (opensearch-project#14605)

* Star tree mapping changes with feature flag
---------
Signed-off-by: Bharathwaj G <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>

* OnHeap Star Tree Implementation

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressed major nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* includes Count Aggregator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* handling for missing doc values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* addressing review comments

Signed-off-by: Sarthak Aggarwal <[email protected]>

* rebasing with main

Signed-off-by: Sarthak Aggarwal <[email protected]>

* support for empty sequential doc values iterator

Signed-off-by: Sarthak Aggarwal <[email protected]>

* nits

Signed-off-by: Sarthak Aggarwal <[email protected]>

* min and max star tree aggregators

Signed-off-by: Sarthak Aggarwal <[email protected]>

* star tree file formats

* Star tree codec changes

Signed-off-by: Bharathwaj G <[email protected]>

* Adding tests

Signed-off-by: Bharathwaj G <[email protected]>

* Addressing comments

Signed-off-by: Bharathwaj G <[email protected]>

* addressing review comments

Signed-off-by: Bharathwaj G <[email protected]>

* Star tree merge changes

Signed-off-by: Bharathwaj G <[email protected]>

* fix annotations

* star-tree file formats reader and javadoc fixes

* read for composite index values

Signed-off-by: Sarthak Aggarwal <[email protected]>

* doc values file format

Signed-off-by: Sarthak Aggarwal <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Prudhvi Godithi <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sagar <[email protected]>
Signed-off-by: kkewwei [email protected]
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: panguixin <[email protected]>
Signed-off-by: Bukhtawar Khan <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Bharathwaj G <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Prudhvi Godithi <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sagar Upadhyaya <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Marc Handalian <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
Co-authored-by: panguixin <[email protected]>
Co-authored-by: Bukhtawar Khan <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
harshavamsi pushed a commit to harshavamsi/OpenSearch that referenced this pull request Jul 12, 2024
amberzsy pushed a commit to amberzsy/OpenSearch-public that referenced this pull request Jul 14, 2024
mch2 pushed a commit that referenced this pull request Jul 16, 2024
…#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Jul 16, 2024
…#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
(cherry picked from commit d33d24e)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
mch2 pushed a commit that referenced this pull request Jul 22, 2024
…#14614) (#14763)

* add query group header propagator



* apply spotless check



* add new propagator in ThreadContext



* spotlessApply



* address comments



* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...



* Updating SHAs



* Update changelog



---------






* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness



* Addressed andrross's comment



* rerun security check



---------





* Correct typo in method name (#14621)




* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)


* Implement unit tests for FilterPathTests (#12067)


* Write warn log if Filter is empty; Add comments (#12067)


* Add changelog



* Remove unnecessary log statement



* Remove unused logger



* Spotless apply



* Remove incorrect changelog



---------





* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)




* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings




* add changelog



* add PR link changelog



* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)




* Fix assertion failure while deleting remote backed index (#14601)




* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning



* Add to CHANGELOG



* Address code review comments



---------




* Star tree codec changes (#14514)

---------



* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* move query group thread context propagator out of ThreadContext



---------






















(cherry picked from commit d33d24e)

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
kaushalmahi12 added a commit to kaushalmahi12/OpenSearch that referenced this pull request Jul 23, 2024
…opensearch-project#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (opensearch-project#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
kaushalmahi12 added a commit to kaushalmahi12/OpenSearch that referenced this pull request Jul 23, 2024
…opensearch-project#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (opensearch-project#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>
kkewwei pushed a commit to kkewwei/OpenSearch that referenced this pull request Jul 24, 2024
…oject#14627)

(cherry picked from commit f1f4f89)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: kkewwei <[email protected]>
kkewwei pushed a commit to kkewwei/OpenSearch that referenced this pull request Jul 24, 2024
…opensearch-project#14614) (opensearch-project#14763)

* add query group header propagator

* apply spotless check

* add new propagator in ThreadContext

* spotlessApply

* address comments

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

* Updating SHAs

* Update changelog

---------

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

* Addressed andrross's comment

* rerun security check

---------

* Correct typo in method name (opensearch-project#14621)

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)

* Implement unit tests for FilterPathTests (opensearch-project#12067)

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)

* Add changelog

* Remove unnecessary log statement

* Remove unused logger

* Spotless apply

* Remove incorrect changelog

---------

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

* add changelog

* add PR link changelog

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

* Add to CHANGELOG

* Address code review comments

---------

* Star tree codec changes (opensearch-project#14514)

---------

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

* Updating SHAs

* Update changelog

---------

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

* Updating SHAs

* Update changelog

---------

* move query group thread context propagator out of ThreadContext

---------

(cherry picked from commit d33d24e)

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: kkewwei <[email protected]>
mch2 pushed a commit that referenced this pull request Jul 30, 2024
…de level (#14708)

* add logic to add headers to Task

Signed-off-by: Kaushal Kumar <[email protected]>

* add logic to add queryGroupId to task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* remove redundant code

Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog entry

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix precommit

Signed-off-by: Kaushal Kumar <[email protected]>

* Add UTs for RemoteIndexMetadataManager (#14660)

Signed-off-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#10959)

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes
Signed-off-by: Gao Binlong <[email protected]>

* Add more test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Change the indexAnalyzer used by prefix field

Signed-off-by: Gao Binlong <[email protected]>

* Skip old version for yaml test

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Modify yaml test description

Signed-off-by: Gao Binlong <[email protected]>

* Remove the name parameter for setAnalyzer()

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Offline calculation of total shard per node and caching it for weight calculation inside LocalShardBalancer (#14675)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [bug fix] validate lower bound for top n size (#14587)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create SystemIndexRegistry with helper method matchesSystemIndex (#14415)

* Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* WIP on system indices from IndexNameExpressionResolver

Signed-off-by: Craig Perkins <[email protected]>

* Add test in IndexNameExpressionResolverTests

Signed-off-by: Craig Perkins <[email protected]>

* Remove changes in SystemIndexPlugin

Signed-off-by: Craig Perkins <[email protected]>

* Add method in IndexNameExpressionResolver to get matching system indices

Signed-off-by: Craig Perkins <[email protected]>

* Show how resolver can be chained to get system indices

Signed-off-by: Craig Perkins <[email protected]>

* Fix forbiddenApis check

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Make SystemIndices internal

Signed-off-by: Craig Perkins <[email protected]>

* Remove unneeded changes

Signed-off-by: Craig Perkins <[email protected]>

* Fix CI failures

Signed-off-by: Craig Perkins <[email protected]>

* Fix precommit errors

Signed-off-by: Craig Perkins <[email protected]>

* Use Regex instead of WildcardMatcher

Signed-off-by: Craig Perkins <[email protected]>

* Address code review feedback

Signed-off-by: Craig Perkins <[email protected]>

* Allow caller to pass index expressions

Signed-off-by: Craig Perkins <[email protected]>

* Create SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Remove singleton limitation

Signed-off-by: Craig Perkins <[email protected]>

* Add javadoc

Signed-off-by: Craig Perkins <[email protected]>

* Add @experimentalapi annotation

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor Grok validate pattern to iterative approach (#14206)

* grok validate patterns recusrion to iterative

Signed-off-by: Sandesh Kumar <[email protected]>

* Add max depth in resolving a pattern to avoid OOM

Signed-off-by: Sandesh Kumar <[email protected]>

* change path from deque to arraylist

Signed-off-by: Sandesh Kumar <[email protected]>

* rename queue to stack

Signed-off-by: Sandesh Kumar <[email protected]>

* Change max depth to 500

Signed-off-by: Sandesh Kumar <[email protected]>

* typo originPatternName fix

Signed-off-by: Sandesh Kumar <[email protected]>

* spotless

Signed-off-by: Sandesh Kumar <[email protected]>

---------

Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump opentelemetry from 1.39.0 to 1.40.0 (#14674)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump jackson from 2.17.1 to 2.17.2 (#14687)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add release notes for release 1.3.18 (#14699)

Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump reactor from 3.5.19 to 3.5.20 (#14697)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add unit tests for read flow of RemoteClusterStateService and bug fix for transient settings (#14476)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update version check for the bug fix of match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#14703)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove unnecessary cast to int from test (#14696)

Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* print reason why parent task was cancelled (#14604)

Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use set of shard routing for shard in unassigned shard batch check. (#14533)

Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add versioning for UploadedIndexMetadata (#14677)

* Add versioning for UploadedIndexMetadata
* Handle componentPrefix for backward compatibility

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix: update help output for _cat (#14722)

* fixed help output for _cat

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

---------

Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture kerb-admin & hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14729)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update to Gradle 8.9 (#14574)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14732)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (#14555)

* The dynamic mapping parameter supports strict_allow_templates

Signed-off-by: Gao Binlong <[email protected]>

* Modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Modify skip version in yml test file

Signed-off-by: Gao Binlong <[email protected]>

* Refactor some code

Signed-off-by: Gao Binlong <[email protected]>

* Keep the old methods

Signed-off-by: Gao Binlong <[email protected]>

* change public to private

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Do not override toString method for Dynamic

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code and modify the changelog

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:json-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14748)

* Bump net.minidev:json-smart in /plugins/repository-azure

Bumps [net.minidev:json-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:json-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* remove query insights plugin from core (#14743)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (#14555) (#14737) (#14742)

* The dynamic mapping parameter supports strict_allow_templates

* Modify change log

* Modify skip version in yml test file

* Refactor some code

* Keep the old methods

* change public to private

* Optimize some code

* Do not override toString method for Dynamic

* Optimize some code and modify the changelog

---------

(cherry picked from commit 6b8b3ef)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (#14719)

* Fix create or update alias API doesn't throw exception for unsupported parameters

Signed-off-by: Gao Binlong <[email protected]>

* Update version check in yml test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove query categorization from core (#14759)

* Remove query categorization from core

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Trigger Build

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add changes to propagate queryGroupId across child requests and nodes (#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add consumers to remote store based index settings (#14764)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry (#14750)

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Use single data structure to keep track of system indices

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

* Add test for getAllDescriptors

Signed-off-by: Craig Perkins <[email protected]>

* Update server/src/main/java/org/opensearch/indices/SystemIndexRegistry.java

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* SPI for loading ABC templates (#14659)

* SPI for loading ABC templates

Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#12891)

* Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches with the index template

Signed-off-by: Gao Binlong <[email protected]>

* Modify changelog & comment

Signed-off-by: Gao Binlong <[email protected]>

* Use new approach

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix flaky test due to node being used across all tests (#14787)

Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star Tree Implementation [OnHeap] (#14512)

---------
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add Gao Binlong as maintainer (#14796)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear ehcache disk cache files during initialization (#14738)

* Clear ehcache disk cache files during initialization

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding UT to fix line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more Uts for better line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Throwing exception in case we fail to clear cache files during startup

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more UTs

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding a UT for more coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle build

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Update ehcache disk cache close() logic

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor remote-routing-table service inline with remote state interfaces (#14668)

---------
Signed-off-by: Arpit Bandejiya <[email protected]>
Signed-off-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Set version to 2.15 for determining metadata during migration to remote store

Signed-off-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#14793)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (#14769)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Change RCSS info logs to debug (#14814)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993) (#14385)

* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993)

Signed-off-by: Daniil Roman <[email protected]>

* Add fix info to CHANGELOG.md

Signed-off-by: Daniil Roman <[email protected]>

---------

Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Run performance benchmark on pull requests (#14760)

* add performance benchmark workflow for pull requests

Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

---------

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* fix constant_keyword field type (#14807)

Signed-off-by: kkewwei <[email protected]>

test

Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Store Migration] Reconcile remote store based index settings during STRICT mode switch (#14792)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add prefix mode verification setting for repository verification (#14790)

* Add prefix mode verification setting for repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Add UTs and randomise prefix mode repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review feedback

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add length check on comment body for benchmark workflow (#14834)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add restore-from-snapshot test procedure for snapshot run benchmark config (#14842)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix env variable name typo (#14843)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use circuit breaker in InternalHistogram when adding empty buckets (#14754)

* introduce circuit breaker in InternalHistogram

Signed-off-by: bowenlan-amzn <[email protected]>

* use circuit breaker from reduce context

Signed-off-by: bowenlan-amzn <[email protected]>

* add test

Signed-off-by: bowenlan-amzn <[email protected]>

* revert use_real_memory change in OpenSearchNode

Signed-off-by: bowenlan-amzn <[email protected]>

* add change log

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote State] Create interface RemoteEntitiesManager (#14671)

* Create interface RemoteEntitiesManager

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimise TransportNodesAction to not send DiscoveryNodes for NodeStat… (#14749)

* Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Enabling term version check on local state for all ClusterManager Read Transport Actions (#14273)

* enabling term version check on local state for all admin read actions

Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Reduce logging in DEBUG for MasterService:run (#14795)

* Reduce logging in DEBUG for MasteService:run by introducing short and long summary in Taskbatcher

Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SplitResponseProcessor to Search Pipelines (#14800)

* Add SplitResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Register the split processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Avoid list copy by casting array

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add integration tests for RemoteRoutingTable Service. (#14631)

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SortResponseProcessor to Search Pipelines (#14785)

* Add SortResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Add stupid and unnecessary javadocs to satisfy overly strict CI

Signed-off-by: Daniel Widdis <[email protected]>

* Split casting and sorting methods for readability

Signed-off-by: Daniel Widdis <[email protected]>

* Register the sort processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Cast individual list elements to avoid creating two lists

Signed-off-by: Daniel Widdis <[email protected]>

* Add yamlRestTests

Signed-off-by: Daniel Widdis <[email protected]>

* Clarify why there's unusual sorting

Signed-off-by: Daniel Widdis <[email protected]>

* Use instanceof instead of isAssignableFrom

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix allowUnmappedFields, mapUnmappedFieldAsString settings to be applied when parsing query string query (#13957)

* Modify to invoke QueryShardContext.fieldMapper() method to apply allowUnmappedFields and mapUnmappedFieldAsString settings

Signed-off-by: imyp92 <[email protected]>

* Add test cases to verify returning 400 responses if unmapped fields are included for some types of query

Signed-off-by: imyp92 <[email protected]>

* Add changelog

Signed-off-by: imyp92 <[email protected]>

---------

Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.16.0 to 1.16.1 in /plugins/repository-azure (#14857)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.16.0...v1.16.1)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.gradle.develocity from 3.17.5 to 3.17.6 (#14856)

* Bump com.gradle.develocity from 3.17.5 to 3.17.6

Bumps com.gradle.develocity from 3.17.5 to 3.17.6.

---
updated-dependencies:
- dependency-name: com.gradle.develocity
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump org.jline:jline in /test/fixtures/hdfs-fixture (#14859)

Bumps [org.jline:jline](https://github.com/jline/jline3) from 3.26.2 to 3.26.3.
- [Release notes](https://github.com/jline/jline3/releases)
- [Changelog](https://github.com/jline/jline3/blob/master/changelog.md)
- [Commits](jline/jline3@jline-parent-3.26.2...jline-parent-3.26.3)

---
updated-dependencies:
- dependency-name: org.jline:jline
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use Lucene provided Persian stem (#14847)

Lucene provided Persian stem apparently isn't hooked yet and this change is
doing that based on what is done for Arabic stem support.

Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump actions/checkout from 2 to 4 (#14858)

* Bump actions/checkout from 2 to 4

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Deprecate batch_size parameter on bulk API (#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add perms for remote snapshot cache eviction on scripted query (#14411)

Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add transport interceptor to populate queryGroupId in task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* Add rest, transport layer changes for Hot to warm tiering - dedicated setup (#13980)

Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create listener to refresh search thread resource usage (#14832)

* [bug fix] fix incorrect coordinator node search resource usages

Signed-off-by: Chenyang Ji <[email protected]>

* fix bug on serialization when passing task resource usage to coordinator

Signed-off-by: Chenyang Ji <[email protected]>

* add more unit tests

Signed-off-by: Chenyang Ji <[email protected]>

* remove query insights plugin related code

Signed-off-by: Chenyang Ji <[email protected]>

* create per request listener to refresh task resource usage

Signed-off-by: Chenyang Ji <[email protected]>

* Make new listener API public

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove wrong files added

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Build fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make singleton

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make sure listener runs before plugin listeners

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Minor fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Caching avg total bytes and avg free bytes inside ClusterInfo (#14851)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use default value when index.number_of_replicas is null (#14812)

* Use default value when index.number_of_replicas is null

Signed-off-by: Liyun Xiu <[email protected]>

* Add integration test

Signed-off-by: Liyun Xiu <[email protected]>

* Add changelog

Signed-off-by: Liyun Xiu <[email protected]>

---------

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Routing Table] Implement write and read flow for shard diff file. (#14684)

* Implement write and read flow to upload/download shard diff file.

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimized ClusterStatsIndices to precomute shard stats (#14426)

* Optimize Cluster Stats Indices to precomute node level stats

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix constraint bug which allows more primary shards than average primary shards per index (#14908)

Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optmising AwarenessAllocationDecider for hashmap.get call (#14761)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* update comment

Signed-off-by: Kaushal Kumar <[email protected]>

* Fix IngestServiceTests.testBulkRequestExecutionWithFailures (#14918)

The test would previously fail if the randomness led to only a single
indexing request being included in the bulk payload. This change
guarantees multiple indexing requests in order to ensure the batch logic
kicks in.

Also replace some unneeded mocks with real classes.

Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add queryGroupTask

Signed-off-by: Kaushal Kumar <[email protected]>

* remove unnecessary imports

Signed-off-by: Kaushal Kumar <[email protected]>

* add QueryGroupTask tests

Signed-off-by: Kaushal Kumar <[email protected]>

* rename WLM transport request handler

Signed-off-by: Kaushal Kumar <[email protected]>

* add CHANGELOG entry

Signed-off-by: Kaushal Kumar <[email protected]>

* fix ut

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix UT to remove the verify for final method

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Lukáš Vlček <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: SwethaGuptha <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Ahmed Sobeh <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Co-authored-by: Shourya Dutta Biswas <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Mohit Godwani <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Daniil Roman <[email protected]>
Co-authored-by: Rishabh Singh <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Pranshu Shukla <[email protected]>
Co-authored-by: rajiv-kv <[email protected]>
Co-authored-by: Sumit Bansal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: shailendra0811 <[email protected]>
Co-authored-by: Park, Yeongwu <[email protected]>
Co-authored-by: ebraminio <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Finn <[email protected]>
Co-authored-by: Neetika Singhal <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Gaurav Bafna <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
opensearch-trigger-bot bot added a commit that referenced this pull request Jul 30, 2024
…de level (#14708)

* add logic to add headers to Task

Signed-off-by: Kaushal Kumar <[email protected]>

* add logic to add queryGroupId to task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* remove redundant code

Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog entry

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix precommit

Signed-off-by: Kaushal Kumar <[email protected]>

* Add UTs for RemoteIndexMetadataManager (#14660)

Signed-off-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#10959)

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes
Signed-off-by: Gao Binlong <[email protected]>

* Add more test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Change the indexAnalyzer used by prefix field

Signed-off-by: Gao Binlong <[email protected]>

* Skip old version for yaml test

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Modify yaml test description

Signed-off-by: Gao Binlong <[email protected]>

* Remove the name parameter for setAnalyzer()

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Offline calculation of total shard per node and caching it for weight calculation inside LocalShardBalancer (#14675)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [bug fix] validate lower bound for top n size (#14587)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create SystemIndexRegistry with helper method matchesSystemIndex (#14415)

* Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* WIP on system indices from IndexNameExpressionResolver

Signed-off-by: Craig Perkins <[email protected]>

* Add test in IndexNameExpressionResolverTests

Signed-off-by: Craig Perkins <[email protected]>

* Remove changes in SystemIndexPlugin

Signed-off-by: Craig Perkins <[email protected]>

* Add method in IndexNameExpressionResolver to get matching system indices

Signed-off-by: Craig Perkins <[email protected]>

* Show how resolver can be chained to get system indices

Signed-off-by: Craig Perkins <[email protected]>

* Fix forbiddenApis check

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Make SystemIndices internal

Signed-off-by: Craig Perkins <[email protected]>

* Remove unneeded changes

Signed-off-by: Craig Perkins <[email protected]>

* Fix CI failures

Signed-off-by: Craig Perkins <[email protected]>

* Fix precommit errors

Signed-off-by: Craig Perkins <[email protected]>

* Use Regex instead of WildcardMatcher

Signed-off-by: Craig Perkins <[email protected]>

* Address code review feedback

Signed-off-by: Craig Perkins <[email protected]>

* Allow caller to pass index expressions

Signed-off-by: Craig Perkins <[email protected]>

* Create SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Remove singleton limitation

Signed-off-by: Craig Perkins <[email protected]>

* Add javadoc

Signed-off-by: Craig Perkins <[email protected]>

* Add @experimentalapi annotation

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor Grok validate pattern to iterative approach (#14206)

* grok validate patterns recusrion to iterative

Signed-off-by: Sandesh Kumar <[email protected]>

* Add max depth in resolving a pattern to avoid OOM

Signed-off-by: Sandesh Kumar <[email protected]>

* change path from deque to arraylist

Signed-off-by: Sandesh Kumar <[email protected]>

* rename queue to stack

Signed-off-by: Sandesh Kumar <[email protected]>

* Change max depth to 500

Signed-off-by: Sandesh Kumar <[email protected]>

* typo originPatternName fix

Signed-off-by: Sandesh Kumar <[email protected]>

* spotless

Signed-off-by: Sandesh Kumar <[email protected]>

---------

Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump opentelemetry from 1.39.0 to 1.40.0 (#14674)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump jackson from 2.17.1 to 2.17.2 (#14687)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add release notes for release 1.3.18 (#14699)

Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump reactor from 3.5.19 to 3.5.20 (#14697)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add unit tests for read flow of RemoteClusterStateService and bug fix for transient settings (#14476)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update version check for the bug fix of match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#14703)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove unnecessary cast to int from test (#14696)

Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* print reason why parent task was cancelled (#14604)

Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use set of shard routing for shard in unassigned shard batch check. (#14533)

Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add versioning for UploadedIndexMetadata (#14677)

* Add versioning for UploadedIndexMetadata
* Handle componentPrefix for backward compatibility

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix: update help output for _cat (#14722)

* fixed help output for _cat

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

---------

Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture kerb-admin & hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14729)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update to Gradle 8.9 (#14574)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14732)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (#14555)

* The dynamic mapping parameter supports strict_allow_templates

Signed-off-by: Gao Binlong <[email protected]>

* Modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Modify skip version in yml test file

Signed-off-by: Gao Binlong <[email protected]>

* Refactor some code

Signed-off-by: Gao Binlong <[email protected]>

* Keep the old methods

Signed-off-by: Gao Binlong <[email protected]>

* change public to private

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Do not override toString method for Dynamic

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code and modify the changelog

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:json-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14748)

* Bump net.minidev:json-smart in /plugins/repository-azure

Bumps [net.minidev:json-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:json-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* remove query insights plugin from core (#14743)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (#14555) (#14737) (#14742)

* The dynamic mapping parameter supports strict_allow_templates

* Modify change log

* Modify skip version in yml test file

* Refactor some code

* Keep the old methods

* change public to private

* Optimize some code

* Do not override toString method for Dynamic

* Optimize some code and modify the changelog

---------

(cherry picked from commit 6b8b3ef)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (#14719)

* Fix create or update alias API doesn't throw exception for unsupported parameters

Signed-off-by: Gao Binlong <[email protected]>

* Update version check in yml test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove query categorization from core (#14759)

* Remove query categorization from core

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Trigger Build

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add changes to propagate queryGroupId across child requests and nodes (#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add consumers to remote store based index settings (#14764)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry (#14750)

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Use single data structure to keep track of system indices

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

* Add test for getAllDescriptors

Signed-off-by: Craig Perkins <[email protected]>

* Update server/src/main/java/org/opensearch/indices/SystemIndexRegistry.java

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* SPI for loading ABC templates (#14659)

* SPI for loading ABC templates

Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#12891)

* Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches with the index template

Signed-off-by: Gao Binlong <[email protected]>

* Modify changelog & comment

Signed-off-by: Gao Binlong <[email protected]>

* Use new approach

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix flaky test due to node being used across all tests (#14787)

Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star Tree Implementation [OnHeap] (#14512)

---------
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add Gao Binlong as maintainer (#14796)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear ehcache disk cache files during initialization (#14738)

* Clear ehcache disk cache files during initialization

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding UT to fix line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more Uts for better line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Throwing exception in case we fail to clear cache files during startup

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more UTs

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding a UT for more coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle build

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Update ehcache disk cache close() logic

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor remote-routing-table service inline with remote state interfaces (#14668)

---------
Signed-off-by: Arpit Bandejiya <[email protected]>
Signed-off-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Set version to 2.15 for determining metadata during migration to remote store

Signed-off-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#14793)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (#14769)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Change RCSS info logs to debug (#14814)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993) (#14385)

* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993)

Signed-off-by: Daniil Roman <[email protected]>

* Add fix info to CHANGELOG.md

Signed-off-by: Daniil Roman <[email protected]>

---------

Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Run performance benchmark on pull requests (#14760)

* add performance benchmark workflow for pull requests

Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

---------

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* fix constant_keyword field type (#14807)

Signed-off-by: kkewwei <[email protected]>

test

Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Store Migration] Reconcile remote store based index settings during STRICT mode switch (#14792)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add prefix mode verification setting for repository verification (#14790)

* Add prefix mode verification setting for repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Add UTs and randomise prefix mode repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review feedback

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add length check on comment body for benchmark workflow (#14834)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add restore-from-snapshot test procedure for snapshot run benchmark config (#14842)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix env variable name typo (#14843)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use circuit breaker in InternalHistogram when adding empty buckets (#14754)

* introduce circuit breaker in InternalHistogram

Signed-off-by: bowenlan-amzn <[email protected]>

* use circuit breaker from reduce context

Signed-off-by: bowenlan-amzn <[email protected]>

* add test

Signed-off-by: bowenlan-amzn <[email protected]>

* revert use_real_memory change in OpenSearchNode

Signed-off-by: bowenlan-amzn <[email protected]>

* add change log

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote State] Create interface RemoteEntitiesManager (#14671)

* Create interface RemoteEntitiesManager

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimise TransportNodesAction to not send DiscoveryNodes for NodeStat… (#14749)

* Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Enabling term version check on local state for all ClusterManager Read Transport Actions (#14273)

* enabling term version check on local state for all admin read actions

Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Reduce logging in DEBUG for MasterService:run (#14795)

* Reduce logging in DEBUG for MasteService:run by introducing short and long summary in Taskbatcher

Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SplitResponseProcessor to Search Pipelines (#14800)

* Add SplitResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Register the split processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Avoid list copy by casting array

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add integration tests for RemoteRoutingTable Service. (#14631)

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SortResponseProcessor to Search Pipelines (#14785)

* Add SortResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Add stupid and unnecessary javadocs to satisfy overly strict CI

Signed-off-by: Daniel Widdis <[email protected]>

* Split casting and sorting methods for readability

Signed-off-by: Daniel Widdis <[email protected]>

* Register the sort processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Cast individual list elements to avoid creating two lists

Signed-off-by: Daniel Widdis <[email protected]>

* Add yamlRestTests

Signed-off-by: Daniel Widdis <[email protected]>

* Clarify why there's unusual sorting

Signed-off-by: Daniel Widdis <[email protected]>

* Use instanceof instead of isAssignableFrom

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix allowUnmappedFields, mapUnmappedFieldAsString settings to be applied when parsing query string query (#13957)

* Modify to invoke QueryShardContext.fieldMapper() method to apply allowUnmappedFields and mapUnmappedFieldAsString settings

Signed-off-by: imyp92 <[email protected]>

* Add test cases to verify returning 400 responses if unmapped fields are included for some types of query

Signed-off-by: imyp92 <[email protected]>

* Add changelog

Signed-off-by: imyp92 <[email protected]>

---------

Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.16.0 to 1.16.1 in /plugins/repository-azure (#14857)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.16.0...v1.16.1)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.gradle.develocity from 3.17.5 to 3.17.6 (#14856)

* Bump com.gradle.develocity from 3.17.5 to 3.17.6

Bumps com.gradle.develocity from 3.17.5 to 3.17.6.

---
updated-dependencies:
- dependency-name: com.gradle.develocity
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump org.jline:jline in /test/fixtures/hdfs-fixture (#14859)

Bumps [org.jline:jline](https://github.com/jline/jline3) from 3.26.2 to 3.26.3.
- [Release notes](https://github.com/jline/jline3/releases)
- [Changelog](https://github.com/jline/jline3/blob/master/changelog.md)
- [Commits](jline/jline3@jline-parent-3.26.2...jline-parent-3.26.3)

---
updated-dependencies:
- dependency-name: org.jline:jline
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use Lucene provided Persian stem (#14847)

Lucene provided Persian stem apparently isn't hooked yet and this change is
doing that based on what is done for Arabic stem support.

Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump actions/checkout from 2 to 4 (#14858)

* Bump actions/checkout from 2 to 4

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Deprecate batch_size parameter on bulk API (#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add perms for remote snapshot cache eviction on scripted query (#14411)

Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add transport interceptor to populate queryGroupId in task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* Add rest, transport layer changes for Hot to warm tiering - dedicated setup (#13980)

Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create listener to refresh search thread resource usage (#14832)

* [bug fix] fix incorrect coordinator node search resource usages

Signed-off-by: Chenyang Ji <[email protected]>

* fix bug on serialization when passing task resource usage to coordinator

Signed-off-by: Chenyang Ji <[email protected]>

* add more unit tests

Signed-off-by: Chenyang Ji <[email protected]>

* remove query insights plugin related code

Signed-off-by: Chenyang Ji <[email protected]>

* create per request listener to refresh task resource usage

Signed-off-by: Chenyang Ji <[email protected]>

* Make new listener API public

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove wrong files added

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Build fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make singleton

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make sure listener runs before plugin listeners

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Minor fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Caching avg total bytes and avg free bytes inside ClusterInfo (#14851)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use default value when index.number_of_replicas is null (#14812)

* Use default value when index.number_of_replicas is null

Signed-off-by: Liyun Xiu <[email protected]>

* Add integration test

Signed-off-by: Liyun Xiu <[email protected]>

* Add changelog

Signed-off-by: Liyun Xiu <[email protected]>

---------

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Routing Table] Implement write and read flow for shard diff file. (#14684)

* Implement write and read flow to upload/download shard diff file.

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimized ClusterStatsIndices to precomute shard stats (#14426)

* Optimize Cluster Stats Indices to precomute node level stats

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix constraint bug which allows more primary shards than average primary shards per index (#14908)

Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optmising AwarenessAllocationDecider for hashmap.get call (#14761)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* update comment

Signed-off-by: Kaushal Kumar <[email protected]>

* Fix IngestServiceTests.testBulkRequestExecutionWithFailures (#14918)

The test would previously fail if the randomness led to only a single
indexing request being included in the bulk payload. This change
guarantees multiple indexing requests in order to ensure the batch logic
kicks in.

Also replace some unneeded mocks with real classes.

Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add queryGroupTask

Signed-off-by: Kaushal Kumar <[email protected]>

* remove unnecessary imports

Signed-off-by: Kaushal Kumar <[email protected]>

* add QueryGroupTask tests

Signed-off-by: Kaushal Kumar <[email protected]>

* rename WLM transport request handler

Signed-off-by: Kaushal Kumar <[email protected]>

* add CHANGELOG entry

Signed-off-by: Kaushal Kumar <[email protected]>

* fix ut

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix UT to remove the verify for final method

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Lukáš Vlček <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: SwethaGuptha <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Ahmed Sobeh <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Co-authored-by: Shourya Dutta Biswas <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Mohit Godwani <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Daniil Roman <[email protected]>
Co-authored-by: Rishabh Singh <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Pranshu Shukla <[email protected]>
Co-authored-by: rajiv-kv <[email protected]>
Co-authored-by: Sumit Bansal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: shailendra0811 <[email protected]>
Co-authored-by: Park, Yeongwu <[email protected]>
Co-authored-by: ebraminio <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Finn <[email protected]>
Co-authored-by: Neetika Singhal <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Gaurav Bafna <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
(cherry picked from commit eb306d2)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
jed326 added a commit that referenced this pull request Aug 7, 2024
…de level (#14708) (#15029)

* add logic to add headers to Task



* add logic to add queryGroupId to task headers



* remove redundant code



* add changelog entry



* address comments



* fix precommit



* Add UTs for RemoteIndexMetadataManager (#14660)





* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#10959)

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes


* Add more test



* modify change log



* Fix test failure



* Change the indexAnalyzer used by prefix field



* Skip old version for yaml test



* Optimize some code



* Fix test failure



* Modify yaml test description



* Remove the name parameter for setAnalyzer()



---------




* Offline calculation of total shard per node and caching it for weight calculation inside LocalShardBalancer (#14675)




* [bug fix] validate lower bound for top n size (#14587)




* Create SystemIndexRegistry with helper method matchesSystemIndex (#14415)

* Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices



* Add to CHANGELOG



* WIP on system indices from IndexNameExpressionResolver



* Add test in IndexNameExpressionResolverTests



* Remove changes in SystemIndexPlugin



* Add method in IndexNameExpressionResolver to get matching system indices



* Show how resolver can be chained to get system indices



* Fix forbiddenApis check



* Update CHANGELOG



* Make SystemIndices internal



* Remove unneeded changes



* Fix CI failures



* Fix precommit errors



* Use Regex instead of WildcardMatcher



* Address code review feedback



* Allow caller to pass index expressions



* Create SystemIndexRegistry



* Update CHANGELOG



* Remove singleton limitation



* Add javadoc



* Add @experimentalapi annotation



---------




* Refactor Grok validate pattern to iterative approach (#14206)

* grok validate patterns recusrion to iterative



* Add max depth in resolving a pattern to avoid OOM



* change path from deque to arraylist



* rename queue to stack



* Change max depth to 500



* typo originPatternName fix



* spotless



---------




* Bump opentelemetry from 1.39.0 to 1.40.0 (#14674)




* Bump jackson from 2.17.1 to 2.17.2 (#14687)




* Add release notes for release 1.3.18 (#14699)




* Bump reactor from 3.5.19 to 3.5.20 (#14697)




* Add unit tests for read flow of RemoteClusterStateService and bug fix for transient settings (#14476)




* Update version check for the bug fix of match_phrase_prefix_query not working on text field with multiple values and index_prefixes (#14703)




* Remove unnecessary cast to int from test (#14696)




* print reason why parent task was cancelled (#14604)




* Use set of shard routing for shard in unassigned shard batch check. (#14533)




* Add versioning for UploadedIndexMetadata (#14677)

* Add versioning for UploadedIndexMetadata
* Handle componentPrefix for backward compatibility




* Fix: update help output for _cat (#14722)

* fixed help output for _cat



* updated changelog



* updated changelog



---------




* Fix hdfs-fixture kerb-admin & hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14729)




* Update to Gradle 8.9 (#14574)




* Fix hdfs-fixture hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (#14732)




* Add `strict_allow_templates` dynamic mapping option (#14555)

* The dynamic mapping parameter supports strict_allow_templates



* Modify change log



* Modify skip version in yml test file



* Refactor some code



* Keep the old methods



* change public to private



* Optimize some code



* Do not override toString method for Dynamic



* Optimize some code and modify the changelog



---------




* Bump net.minidev:json-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14748)

* Bump net.minidev:json-smart in /plugins/repository-azure

Bumps [net.minidev:json-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:json-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* remove query insights plugin from core (#14743)




* Add `strict_allow_templates` dynamic mapping option (#14555) (#14737) (#14742)

* The dynamic mapping parameter supports strict_allow_templates

* Modify change log

* Modify skip version in yml test file

* Refactor some code

* Keep the old methods

* change public to private

* Optimize some code

* Do not override toString method for Dynamic

* Optimize some code and modify the changelog

---------

(cherry picked from commit 6b8b3ef)








* Fix create or update alias API doesn't throw exception for unsupported parameters (#14719)

* Fix create or update alias API doesn't throw exception for unsupported parameters



* Update version check in yml test



* modify change log



---------




* Remove query categorization from core (#14759)

* Remove query categorization from core



* Add changelog



* Trigger Build



---------




* Add changes to propagate queryGroupId across child requests and nodes (#14614)

* add query group header propagator



* apply spotless check



* add new propagator in ThreadContext



* spotlessApply



* address comments



* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...



* Updating SHAs



* Update changelog



---------






* [Bugfix] Fix ICacheKeySerializerTests flakiness (#14564)

* Fix testInvalidInput flakiness



* Addressed andrross's comment



* rerun security check



---------





* Correct typo in method name (#14621)




* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (#14200)

* Refactor FilterPath parse function (#12067)


* Implement unit tests for FilterPathTests (#12067)


* Write warn log if Filter is empty; Add comments (#12067)


* Add changelog



* Remove unnecessary log statement



* Remove unused logger



* Spotless apply



* Remove incorrect changelog



---------





* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(#14612)




* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings




* add changelog



* add PR link changelog



* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (#14613)




* Fix assertion failure while deleting remote backed index (#14601)




* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (#14635)

* Allow system index warning



* Add to CHANGELOG



* Address code review comments



---------




* Star tree codec changes (#14514)

---------



* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* move query group thread context propagator out of ThreadContext



---------
























* Add consumers to remote store based index settings (#14764)




* Add matchesPluginSystemIndexPattern to SystemIndexRegistry (#14750)

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry



* Add to CHANGELOG



* Use single data structure to keep track of system indices



* Address code review comments



* Add test for getAllDescriptors



* Update server/src/main/java/org/opensearch/indices/SystemIndexRegistry.java




---------






* SPI for loading ABC templates (#14659)

* SPI for loading ABC templates




* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#12891)

* Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches with the index template



* Modify changelog & comment



* Use new approach



* Fix test failure



---------




* Fix flaky test due to node being used across all tests (#14787)




* Star Tree Implementation [OnHeap] (#14512)

---------



* Add Gao Binlong as maintainer (#14796)




* Clear ehcache disk cache files during initialization (#14738)

* Clear ehcache disk cache files during initialization



* Adding UT to fix line coverage



* Addressing comment



* Adding more Uts for better line coverage



* Throwing exception in case we fail to clear cache files during startup



* Adding more UTs



* Adding a UT for more coverage



* Fixing gradle build



* Update ehcache disk cache close() logic



---------




* Refactor remote-routing-table service inline with remote state interfaces (#14668)

---------




* Set version to 2.15 for determining metadata during migration to remote store





* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (#14793)




* Fix create or update alias API doesn't throw exception for unsupported parameters (#14769)




* Change RCSS info logs to debug (#14814)




* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993) (#14385)

* [Bugfix] Fix NPE in ReplicaShardAllocator (#13993)



* Add fix info to CHANGELOG.md



---------





* Run performance benchmark on pull requests (#14760)

* add performance benchmark workflow for pull requests



* Update PERFORMANCE_BENCHMARKS.md




* Update PERFORMANCE_BENCHMARKS.md




* Update .github/workflows/benchmark-pull-request.yml




* Update .github/workflows/benchmark-pull-request.yml




* Update .github/workflows/benchmark-pull-request.yml




* Update .github/workflows/benchmark-pull-request.yml




---------






* fix constant_keyword field type (#14807)



test





* [Remote Store Migration] Reconcile remote store based index settings during STRICT mode switch (#14792)




* Add prefix mode verification setting for repository verification (#14790)

* Add prefix mode verification setting for repository verification



* Add UTs and randomise prefix mode repository verification



* Incorporate PR review feedback



---------




* add length check on comment body for benchmark workflow (#14834)




* Add restore-from-snapshot test procedure for snapshot run benchmark config (#14842)




* Fix env variable name typo (#14843)




* Use circuit breaker in InternalHistogram when adding empty buckets (#14754)

* introduce circuit breaker in InternalHistogram



* use circuit breaker from reduce context



* add test



* revert use_real_memory change in OpenSearchNode



* add change log



---------




* [Remote State] Create interface RemoteEntitiesManager (#14671)

* Create interface RemoteEntitiesManager




* Optimise TransportNodesAction to not send DiscoveryNodes for NodeStat… (#14749)

* Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call




* Enabling term version check on local state for all ClusterManager Read Transport Actions (#14273)

* enabling term version check on local state for all admin read actions




* Reduce logging in DEBUG for MasterService:run (#14795)

* Reduce logging in DEBUG for MasteService:run by introducing short and long summary in Taskbatcher




* Add SplitResponseProcessor to Search Pipelines (#14800)

* Add SplitResponseProcessor for search pipelines



* Register the split processor factory



* Address code review comments



* Avoid list copy by casting array



---------




* Add integration tests for RemoteRoutingTable Service. (#14631)




* Add SortResponseProcessor to Search Pipelines (#14785)

* Add SortResponseProcessor for search pipelines



* Add stupid and unnecessary javadocs to satisfy overly strict CI



* Split casting and sorting methods for readability



* Register the sort processor factory



* Address code review comments



* Cast individual list elements to avoid creating two lists



* Add yamlRestTests



* Clarify why there's unusual sorting



* Use instanceof instead of isAssignableFrom



---------




* Fix allowUnmappedFields, mapUnmappedFieldAsString settings to be applied when parsing query string query (#13957)

* Modify to invoke QueryShardContext.fieldMapper() method to apply allowUnmappedFields and mapUnmappedFieldAsString settings



* Add test cases to verify returning 400 responses if unmapped fields are included for some types of query



* Add changelog



---------






* Bump com.microsoft.azure:msal4j from 1.16.0 to 1.16.1 in /plugins/repository-azure (#14857)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.16.0...v1.16.1)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Updating SHAs



* Update changelog



---------






* Bump com.gradle.develocity from 3.17.5 to 3.17.6 (#14856)

* Bump com.gradle.develocity from 3.17.5 to 3.17.6

Bumps com.gradle.develocity from 3.17.5 to 3.17.6.

---
updated-dependencies:
- dependency-name: com.gradle.develocity
  dependency-type: direct:production
  update-type: version-update:semver-patch
...



* Update changelog



---------






* Bump org.jline:jline in /test/fixtures/hdfs-fixture (#14859)

Bumps [org.jline:jline](https://github.com/jline/jline3) from 3.26.2 to 3.26.3.
- [Release notes](https://github.com/jline/jline3/releases)
- [Changelog](https://github.com/jline/jline3/blob/master/changelog.md)
- [Commits](jline/jline3@jline-parent-3.26.2...jline-parent-3.26.3)

---
updated-dependencies:
- dependency-name: org.jline:jline
  dependency-type: direct:production
  update-type: version-update:semver-patch
...





* Use Lucene provided Persian stem (#14847)

Lucene provided Persian stem apparently isn't hooked yet and this change is
doing that based on what is done for Arabic stem support.






* Bump actions/checkout from 2 to 4 (#14858)

* Bump actions/checkout from 2 to 4

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...



* Update changelog



---------






* Deprecate batch_size parameter on bulk API (#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.




* Add perms for remote snapshot cache eviction on scripted query (#14411)




* add transport interceptor to populate queryGroupId in task headers



* Add rest, transport layer changes for Hot to warm tiering - dedicated setup (#13980)




* Create listener to refresh search thread resource usage (#14832)

* [bug fix] fix incorrect coordinator node search resource usages



* fix bug on serialization when passing task resource usage to coordinator



* add more unit tests



* remove query insights plugin related code



* create per request listener to refresh task resource usage



* Make new listener API public



* Add changelog



* Remove wrong files added



* Address review comments



* Build fix



* Make singleton



* Address review comments



* Make sure listener runs before plugin listeners



* Spotless



* Minor fix



---------








* Caching avg total bytes and avg free bytes inside ClusterInfo (#14851)




* Use default value when index.number_of_replicas is null (#14812)

* Use default value when index.number_of_replicas is null



* Add integration test



* Add changelog



---------




* [Remote Routing Table] Implement write and read flow for shard diff file. (#14684)

* Implement write and read flow to upload/download shard diff file.




* Optimized ClusterStatsIndices to precomute shard stats (#14426)

* Optimize Cluster Stats Indices to precomute node level stats




* Fix constraint bug which allows more primary shards than average primary shards per index (#14908)




* Optmising AwarenessAllocationDecider for hashmap.get call (#14761)




* update comment



* Fix IngestServiceTests.testBulkRequestExecutionWithFailures (#14918)

The test would previously fail if the randomness led to only a single
indexing request being included in the bulk payload. This change
guarantees multiple indexing requests in order to ensure the batch logic
kicks in.

Also replace some unneeded mocks with real classes.




* add queryGroupTask



* remove unnecessary imports



* add QueryGroupTask tests



* rename WLM transport request handler



* add CHANGELOG entry



* fix ut



* address comments



* fix UT to remove the verify for final method



* apply spotless



---------




































































































(cherry picked from commit eb306d2)

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Lukáš Vlček <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: SwethaGuptha <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Ahmed Sobeh <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Co-authored-by: Shourya Dutta Biswas <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Mohit Godwani <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Daniil Roman <[email protected]>
Co-authored-by: Rishabh Singh <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Pranshu Shukla <[email protected]>
Co-authored-by: rajiv-kv <[email protected]>
Co-authored-by: Sumit Bansal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: shailendra0811 <[email protected]>
Co-authored-by: Park, Yeongwu <[email protected]>
Co-authored-by: ebraminio <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Finn <[email protected]>
Co-authored-by: Neetika Singhal <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Gaurav Bafna <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
harshavamsi pushed a commit to harshavamsi/OpenSearch that referenced this pull request Aug 20, 2024
…de level (opensearch-project#14708)

* add logic to add headers to Task

Signed-off-by: Kaushal Kumar <[email protected]>

* add logic to add queryGroupId to task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* remove redundant code

Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog entry

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix precommit

Signed-off-by: Kaushal Kumar <[email protected]>

* Add UTs for RemoteIndexMetadataManager (opensearch-project#14660)

Signed-off-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (opensearch-project#10959)

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes
Signed-off-by: Gao Binlong <[email protected]>

* Add more test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Change the indexAnalyzer used by prefix field

Signed-off-by: Gao Binlong <[email protected]>

* Skip old version for yaml test

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Modify yaml test description

Signed-off-by: Gao Binlong <[email protected]>

* Remove the name parameter for setAnalyzer()

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Offline calculation of total shard per node and caching it for weight calculation inside LocalShardBalancer (opensearch-project#14675)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [bug fix] validate lower bound for top n size (opensearch-project#14587)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create SystemIndexRegistry with helper method matchesSystemIndex (opensearch-project#14415)

* Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* WIP on system indices from IndexNameExpressionResolver

Signed-off-by: Craig Perkins <[email protected]>

* Add test in IndexNameExpressionResolverTests

Signed-off-by: Craig Perkins <[email protected]>

* Remove changes in SystemIndexPlugin

Signed-off-by: Craig Perkins <[email protected]>

* Add method in IndexNameExpressionResolver to get matching system indices

Signed-off-by: Craig Perkins <[email protected]>

* Show how resolver can be chained to get system indices

Signed-off-by: Craig Perkins <[email protected]>

* Fix forbiddenApis check

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Make SystemIndices internal

Signed-off-by: Craig Perkins <[email protected]>

* Remove unneeded changes

Signed-off-by: Craig Perkins <[email protected]>

* Fix CI failures

Signed-off-by: Craig Perkins <[email protected]>

* Fix precommit errors

Signed-off-by: Craig Perkins <[email protected]>

* Use Regex instead of WildcardMatcher

Signed-off-by: Craig Perkins <[email protected]>

* Address code review feedback

Signed-off-by: Craig Perkins <[email protected]>

* Allow caller to pass index expressions

Signed-off-by: Craig Perkins <[email protected]>

* Create SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Remove singleton limitation

Signed-off-by: Craig Perkins <[email protected]>

* Add javadoc

Signed-off-by: Craig Perkins <[email protected]>

* Add @experimentalapi annotation

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor Grok validate pattern to iterative approach (opensearch-project#14206)

* grok validate patterns recusrion to iterative

Signed-off-by: Sandesh Kumar <[email protected]>

* Add max depth in resolving a pattern to avoid OOM

Signed-off-by: Sandesh Kumar <[email protected]>

* change path from deque to arraylist

Signed-off-by: Sandesh Kumar <[email protected]>

* rename queue to stack

Signed-off-by: Sandesh Kumar <[email protected]>

* Change max depth to 500

Signed-off-by: Sandesh Kumar <[email protected]>

* typo originPatternName fix

Signed-off-by: Sandesh Kumar <[email protected]>

* spotless

Signed-off-by: Sandesh Kumar <[email protected]>

---------

Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump opentelemetry from 1.39.0 to 1.40.0 (opensearch-project#14674)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump jackson from 2.17.1 to 2.17.2 (opensearch-project#14687)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add release notes for release 1.3.18 (opensearch-project#14699)

Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump reactor from 3.5.19 to 3.5.20 (opensearch-project#14697)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add unit tests for read flow of RemoteClusterStateService and bug fix for transient settings (opensearch-project#14476)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update version check for the bug fix of match_phrase_prefix_query not working on text field with multiple values and index_prefixes (opensearch-project#14703)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove unnecessary cast to int from test (opensearch-project#14696)

Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* print reason why parent task was cancelled (opensearch-project#14604)

Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use set of shard routing for shard in unassigned shard batch check. (opensearch-project#14533)

Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add versioning for UploadedIndexMetadata (opensearch-project#14677)

* Add versioning for UploadedIndexMetadata
* Handle componentPrefix for backward compatibility

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix: update help output for _cat (opensearch-project#14722)

* fixed help output for _cat

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

---------

Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture kerb-admin & hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (opensearch-project#14729)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update to Gradle 8.9 (opensearch-project#14574)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (opensearch-project#14732)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (opensearch-project#14555)

* The dynamic mapping parameter supports strict_allow_templates

Signed-off-by: Gao Binlong <[email protected]>

* Modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Modify skip version in yml test file

Signed-off-by: Gao Binlong <[email protected]>

* Refactor some code

Signed-off-by: Gao Binlong <[email protected]>

* Keep the old methods

Signed-off-by: Gao Binlong <[email protected]>

* change public to private

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Do not override toString method for Dynamic

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code and modify the changelog

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:json-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14748)

* Bump net.minidev:json-smart in /plugins/repository-azure

Bumps [net.minidev:json-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:json-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* remove query insights plugin from core (opensearch-project#14743)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (opensearch-project#14555) (opensearch-project#14737) (opensearch-project#14742)

* The dynamic mapping parameter supports strict_allow_templates

* Modify change log

* Modify skip version in yml test file

* Refactor some code

* Keep the old methods

* change public to private

* Optimize some code

* Do not override toString method for Dynamic

* Optimize some code and modify the changelog

---------

(cherry picked from commit 6b8b3ef)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (opensearch-project#14719)

* Fix create or update alias API doesn't throw exception for unsupported parameters

Signed-off-by: Gao Binlong <[email protected]>

* Update version check in yml test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove query categorization from core (opensearch-project#14759)

* Remove query categorization from core

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Trigger Build

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add changes to propagate queryGroupId across child requests and nodes (opensearch-project#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (opensearch-project#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add consumers to remote store based index settings (opensearch-project#14764)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry (opensearch-project#14750)

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Use single data structure to keep track of system indices

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

* Add test for getAllDescriptors

Signed-off-by: Craig Perkins <[email protected]>

* Update server/src/main/java/org/opensearch/indices/SystemIndexRegistry.java

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* SPI for loading ABC templates (opensearch-project#14659)

* SPI for loading ABC templates

Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (opensearch-project#12891)

* Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches with the index template

Signed-off-by: Gao Binlong <[email protected]>

* Modify changelog & comment

Signed-off-by: Gao Binlong <[email protected]>

* Use new approach

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix flaky test due to node being used across all tests (opensearch-project#14787)

Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star Tree Implementation [OnHeap] (opensearch-project#14512)

---------
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add Gao Binlong as maintainer (opensearch-project#14796)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear ehcache disk cache files during initialization (opensearch-project#14738)

* Clear ehcache disk cache files during initialization

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding UT to fix line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more Uts for better line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Throwing exception in case we fail to clear cache files during startup

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more UTs

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding a UT for more coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle build

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Update ehcache disk cache close() logic

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor remote-routing-table service inline with remote state interfaces (opensearch-project#14668)

---------
Signed-off-by: Arpit Bandejiya <[email protected]>
Signed-off-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Set version to 2.15 for determining metadata during migration to remote store

Signed-off-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (opensearch-project#14793)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (opensearch-project#14769)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Change RCSS info logs to debug (opensearch-project#14814)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix NPE in ReplicaShardAllocator (opensearch-project#13993) (opensearch-project#14385)

* [Bugfix] Fix NPE in ReplicaShardAllocator (opensearch-project#13993)

Signed-off-by: Daniil Roman <[email protected]>

* Add fix info to CHANGELOG.md

Signed-off-by: Daniil Roman <[email protected]>

---------

Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Run performance benchmark on pull requests (opensearch-project#14760)

* add performance benchmark workflow for pull requests

Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

---------

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* fix constant_keyword field type (opensearch-project#14807)

Signed-off-by: kkewwei <[email protected]>

test

Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Store Migration] Reconcile remote store based index settings during STRICT mode switch (opensearch-project#14792)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add prefix mode verification setting for repository verification (opensearch-project#14790)

* Add prefix mode verification setting for repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Add UTs and randomise prefix mode repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review feedback

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add length check on comment body for benchmark workflow (opensearch-project#14834)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add restore-from-snapshot test procedure for snapshot run benchmark config (opensearch-project#14842)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix env variable name typo (opensearch-project#14843)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use circuit breaker in InternalHistogram when adding empty buckets (opensearch-project#14754)

* introduce circuit breaker in InternalHistogram

Signed-off-by: bowenlan-amzn <[email protected]>

* use circuit breaker from reduce context

Signed-off-by: bowenlan-amzn <[email protected]>

* add test

Signed-off-by: bowenlan-amzn <[email protected]>

* revert use_real_memory change in OpenSearchNode

Signed-off-by: bowenlan-amzn <[email protected]>

* add change log

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote State] Create interface RemoteEntitiesManager (opensearch-project#14671)

* Create interface RemoteEntitiesManager

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimise TransportNodesAction to not send DiscoveryNodes for NodeStat… (opensearch-project#14749)

* Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Enabling term version check on local state for all ClusterManager Read Transport Actions (opensearch-project#14273)

* enabling term version check on local state for all admin read actions

Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Reduce logging in DEBUG for MasterService:run (opensearch-project#14795)

* Reduce logging in DEBUG for MasteService:run by introducing short and long summary in Taskbatcher

Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SplitResponseProcessor to Search Pipelines (opensearch-project#14800)

* Add SplitResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Register the split processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Avoid list copy by casting array

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add integration tests for RemoteRoutingTable Service. (opensearch-project#14631)

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SortResponseProcessor to Search Pipelines (opensearch-project#14785)

* Add SortResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Add stupid and unnecessary javadocs to satisfy overly strict CI

Signed-off-by: Daniel Widdis <[email protected]>

* Split casting and sorting methods for readability

Signed-off-by: Daniel Widdis <[email protected]>

* Register the sort processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Cast individual list elements to avoid creating two lists

Signed-off-by: Daniel Widdis <[email protected]>

* Add yamlRestTests

Signed-off-by: Daniel Widdis <[email protected]>

* Clarify why there's unusual sorting

Signed-off-by: Daniel Widdis <[email protected]>

* Use instanceof instead of isAssignableFrom

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix allowUnmappedFields, mapUnmappedFieldAsString settings to be applied when parsing query string query (opensearch-project#13957)

* Modify to invoke QueryShardContext.fieldMapper() method to apply allowUnmappedFields and mapUnmappedFieldAsString settings

Signed-off-by: imyp92 <[email protected]>

* Add test cases to verify returning 400 responses if unmapped fields are included for some types of query

Signed-off-by: imyp92 <[email protected]>

* Add changelog

Signed-off-by: imyp92 <[email protected]>

---------

Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.16.0 to 1.16.1 in /plugins/repository-azure (opensearch-project#14857)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.16.0...v1.16.1)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.gradle.develocity from 3.17.5 to 3.17.6 (opensearch-project#14856)

* Bump com.gradle.develocity from 3.17.5 to 3.17.6

Bumps com.gradle.develocity from 3.17.5 to 3.17.6.

---
updated-dependencies:
- dependency-name: com.gradle.develocity
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump org.jline:jline in /test/fixtures/hdfs-fixture (opensearch-project#14859)

Bumps [org.jline:jline](https://github.com/jline/jline3) from 3.26.2 to 3.26.3.
- [Release notes](https://github.com/jline/jline3/releases)
- [Changelog](https://github.com/jline/jline3/blob/master/changelog.md)
- [Commits](jline/jline3@jline-parent-3.26.2...jline-parent-3.26.3)

---
updated-dependencies:
- dependency-name: org.jline:jline
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use Lucene provided Persian stem (opensearch-project#14847)

Lucene provided Persian stem apparently isn't hooked yet and this change is
doing that based on what is done for Arabic stem support.

Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump actions/checkout from 2 to 4 (opensearch-project#14858)

* Bump actions/checkout from 2 to 4

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Deprecate batch_size parameter on bulk API (opensearch-project#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add perms for remote snapshot cache eviction on scripted query (opensearch-project#14411)

Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add transport interceptor to populate queryGroupId in task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* Add rest, transport layer changes for Hot to warm tiering - dedicated setup (opensearch-project#13980)

Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create listener to refresh search thread resource usage (opensearch-project#14832)

* [bug fix] fix incorrect coordinator node search resource usages

Signed-off-by: Chenyang Ji <[email protected]>

* fix bug on serialization when passing task resource usage to coordinator

Signed-off-by: Chenyang Ji <[email protected]>

* add more unit tests

Signed-off-by: Chenyang Ji <[email protected]>

* remove query insights plugin related code

Signed-off-by: Chenyang Ji <[email protected]>

* create per request listener to refresh task resource usage

Signed-off-by: Chenyang Ji <[email protected]>

* Make new listener API public

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove wrong files added

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Build fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make singleton

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make sure listener runs before plugin listeners

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Minor fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Caching avg total bytes and avg free bytes inside ClusterInfo (opensearch-project#14851)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use default value when index.number_of_replicas is null (opensearch-project#14812)

* Use default value when index.number_of_replicas is null

Signed-off-by: Liyun Xiu <[email protected]>

* Add integration test

Signed-off-by: Liyun Xiu <[email protected]>

* Add changelog

Signed-off-by: Liyun Xiu <[email protected]>

---------

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Routing Table] Implement write and read flow for shard diff file. (opensearch-project#14684)

* Implement write and read flow to upload/download shard diff file.

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimized ClusterStatsIndices to precomute shard stats (opensearch-project#14426)

* Optimize Cluster Stats Indices to precomute node level stats

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix constraint bug which allows more primary shards than average primary shards per index (opensearch-project#14908)

Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optmising AwarenessAllocationDecider for hashmap.get call (opensearch-project#14761)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* update comment

Signed-off-by: Kaushal Kumar <[email protected]>

* Fix IngestServiceTests.testBulkRequestExecutionWithFailures (opensearch-project#14918)

The test would previously fail if the randomness led to only a single
indexing request being included in the bulk payload. This change
guarantees multiple indexing requests in order to ensure the batch logic
kicks in.

Also replace some unneeded mocks with real classes.

Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add queryGroupTask

Signed-off-by: Kaushal Kumar <[email protected]>

* remove unnecessary imports

Signed-off-by: Kaushal Kumar <[email protected]>

* add QueryGroupTask tests

Signed-off-by: Kaushal Kumar <[email protected]>

* rename WLM transport request handler

Signed-off-by: Kaushal Kumar <[email protected]>

* add CHANGELOG entry

Signed-off-by: Kaushal Kumar <[email protected]>

* fix ut

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix UT to remove the verify for final method

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Lukáš Vlček <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: SwethaGuptha <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Ahmed Sobeh <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Co-authored-by: Shourya Dutta Biswas <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Mohit Godwani <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Daniil Roman <[email protected]>
Co-authored-by: Rishabh Singh <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Pranshu Shukla <[email protected]>
Co-authored-by: rajiv-kv <[email protected]>
Co-authored-by: Sumit Bansal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: shailendra0811 <[email protected]>
Co-authored-by: Park, Yeongwu <[email protected]>
Co-authored-by: ebraminio <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Finn <[email protected]>
Co-authored-by: Neetika Singhal <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Gaurav Bafna <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
…opensearch-project#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (opensearch-project#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
wdongyu pushed a commit to wdongyu/OpenSearch that referenced this pull request Aug 22, 2024
…de level (opensearch-project#14708)

* add logic to add headers to Task

Signed-off-by: Kaushal Kumar <[email protected]>

* add logic to add queryGroupId to task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* remove redundant code

Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog entry

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix precommit

Signed-off-by: Kaushal Kumar <[email protected]>

* Add UTs for RemoteIndexMetadataManager (opensearch-project#14660)

Signed-off-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes (opensearch-project#10959)

* Fix match_phrase_prefix_query not working on text field with multiple values and index_prefixes
Signed-off-by: Gao Binlong <[email protected]>

* Add more test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Change the indexAnalyzer used by prefix field

Signed-off-by: Gao Binlong <[email protected]>

* Skip old version for yaml test

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

* Modify yaml test description

Signed-off-by: Gao Binlong <[email protected]>

* Remove the name parameter for setAnalyzer()

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Offline calculation of total shard per node and caching it for weight calculation inside LocalShardBalancer (opensearch-project#14675)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [bug fix] validate lower bound for top n size (opensearch-project#14587)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create SystemIndexRegistry with helper method matchesSystemIndex (opensearch-project#14415)

* Create new extension point in SystemIndexPlugin for a single plugin to get registered system indices

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* WIP on system indices from IndexNameExpressionResolver

Signed-off-by: Craig Perkins <[email protected]>

* Add test in IndexNameExpressionResolverTests

Signed-off-by: Craig Perkins <[email protected]>

* Remove changes in SystemIndexPlugin

Signed-off-by: Craig Perkins <[email protected]>

* Add method in IndexNameExpressionResolver to get matching system indices

Signed-off-by: Craig Perkins <[email protected]>

* Show how resolver can be chained to get system indices

Signed-off-by: Craig Perkins <[email protected]>

* Fix forbiddenApis check

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Make SystemIndices internal

Signed-off-by: Craig Perkins <[email protected]>

* Remove unneeded changes

Signed-off-by: Craig Perkins <[email protected]>

* Fix CI failures

Signed-off-by: Craig Perkins <[email protected]>

* Fix precommit errors

Signed-off-by: Craig Perkins <[email protected]>

* Use Regex instead of WildcardMatcher

Signed-off-by: Craig Perkins <[email protected]>

* Address code review feedback

Signed-off-by: Craig Perkins <[email protected]>

* Allow caller to pass index expressions

Signed-off-by: Craig Perkins <[email protected]>

* Create SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Update CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Remove singleton limitation

Signed-off-by: Craig Perkins <[email protected]>

* Add javadoc

Signed-off-by: Craig Perkins <[email protected]>

* Add @experimentalapi annotation

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor Grok validate pattern to iterative approach (opensearch-project#14206)

* grok validate patterns recusrion to iterative

Signed-off-by: Sandesh Kumar <[email protected]>

* Add max depth in resolving a pattern to avoid OOM

Signed-off-by: Sandesh Kumar <[email protected]>

* change path from deque to arraylist

Signed-off-by: Sandesh Kumar <[email protected]>

* rename queue to stack

Signed-off-by: Sandesh Kumar <[email protected]>

* Change max depth to 500

Signed-off-by: Sandesh Kumar <[email protected]>

* typo originPatternName fix

Signed-off-by: Sandesh Kumar <[email protected]>

* spotless

Signed-off-by: Sandesh Kumar <[email protected]>

---------

Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump opentelemetry from 1.39.0 to 1.40.0 (opensearch-project#14674)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump jackson from 2.17.1 to 2.17.2 (opensearch-project#14687)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add release notes for release 1.3.18 (opensearch-project#14699)

Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump reactor from 3.5.19 to 3.5.20 (opensearch-project#14697)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add unit tests for read flow of RemoteClusterStateService and bug fix for transient settings (opensearch-project#14476)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update version check for the bug fix of match_phrase_prefix_query not working on text field with multiple values and index_prefixes (opensearch-project#14703)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove unnecessary cast to int from test (opensearch-project#14696)

Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* print reason why parent task was cancelled (opensearch-project#14604)

Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use set of shard routing for shard in unassigned shard batch check. (opensearch-project#14533)

Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add versioning for UploadedIndexMetadata (opensearch-project#14677)

* Add versioning for UploadedIndexMetadata
* Handle componentPrefix for backward compatibility

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix: update help output for _cat (opensearch-project#14722)

* fixed help output for _cat

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

* updated changelog

Signed-off-by: ahmedsobeh <[email protected]>

---------

Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture kerb-admin & hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (opensearch-project#14729)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Update to Gradle 8.9 (opensearch-project#14574)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix hdfs-fixture hadoop-minicluster dependencies are not being updated / false positive reports on CVEs (opensearch-project#14732)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (opensearch-project#14555)

* The dynamic mapping parameter supports strict_allow_templates

Signed-off-by: Gao Binlong <[email protected]>

* Modify change log

Signed-off-by: Gao Binlong <[email protected]>

* Modify skip version in yml test file

Signed-off-by: Gao Binlong <[email protected]>

* Refactor some code

Signed-off-by: Gao Binlong <[email protected]>

* Keep the old methods

Signed-off-by: Gao Binlong <[email protected]>

* change public to private

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code

Signed-off-by: Gao Binlong <[email protected]>

* Do not override toString method for Dynamic

Signed-off-by: Gao Binlong <[email protected]>

* Optimize some code and modify the changelog

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:json-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14748)

* Bump net.minidev:json-smart in /plugins/repository-azure

Bumps [net.minidev:json-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:json-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* remove query insights plugin from core (opensearch-project#14743)

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add `strict_allow_templates` dynamic mapping option (opensearch-project#14555) (opensearch-project#14737) (opensearch-project#14742)

* The dynamic mapping parameter supports strict_allow_templates

* Modify change log

* Modify skip version in yml test file

* Refactor some code

* Keep the old methods

* change public to private

* Optimize some code

* Do not override toString method for Dynamic

* Optimize some code and modify the changelog

---------

(cherry picked from commit 6b8b3ef)

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Andriy Redko <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (opensearch-project#14719)

* Fix create or update alias API doesn't throw exception for unsupported parameters

Signed-off-by: Gao Binlong <[email protected]>

* Update version check in yml test

Signed-off-by: Gao Binlong <[email protected]>

* modify change log

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Remove query categorization from core (opensearch-project#14759)

* Remove query categorization from core

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Trigger Build

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add changes to propagate queryGroupId across child requests and nodes (opensearch-project#14614)

* add query group header propagator

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless check

Signed-off-by: Kaushal Kumar <[email protected]>

* add new propagator in ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

* spotlessApply

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.15.1 to 1.16.0 in /plugins/repository-azure (opensearch-project#14610)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.15.1 to 1.16.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.15.1...v1.16.0)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix ICacheKeySerializerTests flakiness (opensearch-project#14564)

* Fix testInvalidInput flakiness

Signed-off-by: Peter Alfonsi <[email protected]>

* Addressed andrross's comment

Signed-off-by: Peter Alfonsi <[email protected]>

* rerun security check

Signed-off-by: Peter Alfonsi <[email protected]>

---------

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Correct typo in method name (opensearch-project#14621)

Signed-off-by: vatsal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactoring FilterPath.parse by using an iterative approach instead of recursion. (opensearch-project#14200)

* Refactor FilterPath parse function (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Implement unit tests for FilterPathTests (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Write warn log if Filter is empty; Add comments (opensearch-project#12067)
Signed-off-by: Robin Friedmann <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unnecessary log statement

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove unused logger

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless apply

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove incorrect changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Removing String format in RemoteStoreMigrationAllocationDecider to optimise performance(opensearch-project#14612)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata; Correct the check for deciding upload of HashesOfConsistentSettings (opensearch-project#14513)

* Clear templates before Adding; Use NamedWriteableAwareStreamInput for RemoteCustomMetadata
* Correct the check for deciding upload of hashes of consistent settings

Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* add PR link changelog

Signed-off-by: Kaushal Kumar <[email protected]>

* Improve reroute performance by optimising List.removeAll in LocalShardsBalancer to filter remote search shard from relocation decision (opensearch-project#14613)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix assertion failure while deleting remote backed index (opensearch-project#14601)

Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Allow system index warning in OpenSearchRestTestCase.refreshAllIndices (opensearch-project#14635)

* Allow system index warning

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star tree codec changes (opensearch-project#14514)

---------
Signed-off-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.github.spullara.mustache.java:compiler from 0.9.13 to 0.9.14 in /modules/lang-mustache (opensearch-project#14672)

* Bump com.github.spullara.mustache.java:compiler

Bumps [com.github.spullara.mustache.java:compiler](https://github.com/spullara/mustache.java) from 0.9.13 to 0.9.14.
- [Commits](spullara/mustache.java@mustache.java-0.9.13...mustache.java-0.9.14)

---
updated-dependencies:
- dependency-name: com.github.spullara.mustache.java:compiler
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump net.minidev:accessors-smart from 2.5.0 to 2.5.1 in /plugins/repository-azure (opensearch-project#14673)

* Bump net.minidev:accessors-smart in /plugins/repository-azure

Bumps [net.minidev:accessors-smart](https://github.com/netplex/json-smart-v2) from 2.5.0 to 2.5.1.
- [Release notes](https://github.com/netplex/json-smart-v2/releases)
- [Commits](netplex/json-smart-v2@2.5.0...2.5.1)

---
updated-dependencies:
- dependency-name: net.minidev:accessors-smart
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* move query group thread context propagator out of ThreadContext

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add consumers to remote store based index settings (opensearch-project#14764)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry (opensearch-project#14750)

* Add matchesPluginSystemIndexPattern to SystemIndexRegistry

Signed-off-by: Craig Perkins <[email protected]>

* Add to CHANGELOG

Signed-off-by: Craig Perkins <[email protected]>

* Use single data structure to keep track of system indices

Signed-off-by: Craig Perkins <[email protected]>

* Address code review comments

Signed-off-by: Craig Perkins <[email protected]>

* Add test for getAllDescriptors

Signed-off-by: Craig Perkins <[email protected]>

* Update server/src/main/java/org/opensearch/indices/SystemIndexRegistry.java

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>

---------

Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* SPI for loading ABC templates (opensearch-project#14659)

* SPI for loading ABC templates

Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (opensearch-project#12891)

* Fix bulk upsert ignores the default_pipeline and final_pipeline when auto-created index matches with the index template

Signed-off-by: Gao Binlong <[email protected]>

* Modify changelog & comment

Signed-off-by: Gao Binlong <[email protected]>

* Use new approach

Signed-off-by: Gao Binlong <[email protected]>

* Fix test failure

Signed-off-by: Gao Binlong <[email protected]>

---------

Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix flaky test due to node being used across all tests (opensearch-project#14787)

Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Star Tree Implementation [OnHeap] (opensearch-project#14512)

---------
Signed-off-by: Sarthak Aggarwal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add Gao Binlong as maintainer (opensearch-project#14796)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Clear ehcache disk cache files during initialization (opensearch-project#14738)

* Clear ehcache disk cache files during initialization

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding UT to fix line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Addressing comment

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more Uts for better line coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Throwing exception in case we fail to clear cache files during startup

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding more UTs

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Adding a UT for more coverage

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Fixing gradle build

Signed-off-by: Sagar Upadhyaya <[email protected]>

* Update ehcache disk cache close() logic

Signed-off-by: Sagar Upadhyaya <[email protected]>

---------

Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Refactor remote-routing-table service inline with remote state interfaces (opensearch-project#14668)

---------
Signed-off-by: Arpit Bandejiya <[email protected]>
Signed-off-by: Arpit-Bandejiya <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Set version to 2.15 for determining metadata during migration to remote store

Signed-off-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix bulk upsert ignores the default_pipeline and final_pipeline when the auto-created index matches the index template (opensearch-project#14793)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix create or update alias API doesn't throw exception for unsupported parameters (opensearch-project#14769)

Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Change RCSS info logs to debug (opensearch-project#14814)

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Bugfix] Fix NPE in ReplicaShardAllocator (opensearch-project#13993) (opensearch-project#14385)

* [Bugfix] Fix NPE in ReplicaShardAllocator (opensearch-project#13993)

Signed-off-by: Daniil Roman <[email protected]>

* Add fix info to CHANGELOG.md

Signed-off-by: Daniil Roman <[email protected]>

---------

Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Run performance benchmark on pull requests (opensearch-project#14760)

* add performance benchmark workflow for pull requests

Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update PERFORMANCE_BENCHMARKS.md

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

* Update .github/workflows/benchmark-pull-request.yml

Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>

---------

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* fix constant_keyword field type (opensearch-project#14807)

Signed-off-by: kkewwei <[email protected]>

test

Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Store Migration] Reconcile remote store based index settings during STRICT mode switch (opensearch-project#14792)

Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add prefix mode verification setting for repository verification (opensearch-project#14790)

* Add prefix mode verification setting for repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Add UTs and randomise prefix mode repository verification

Signed-off-by: Ashish Singh <[email protected]>

* Incorporate PR review feedback

Signed-off-by: Ashish Singh <[email protected]>

---------

Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add length check on comment body for benchmark workflow (opensearch-project#14834)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add restore-from-snapshot test procedure for snapshot run benchmark config (opensearch-project#14842)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix env variable name typo (opensearch-project#14843)

Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use circuit breaker in InternalHistogram when adding empty buckets (opensearch-project#14754)

* introduce circuit breaker in InternalHistogram

Signed-off-by: bowenlan-amzn <[email protected]>

* use circuit breaker from reduce context

Signed-off-by: bowenlan-amzn <[email protected]>

* add test

Signed-off-by: bowenlan-amzn <[email protected]>

* revert use_real_memory change in OpenSearchNode

Signed-off-by: bowenlan-amzn <[email protected]>

* add change log

Signed-off-by: bowenlan-amzn <[email protected]>

---------

Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote State] Create interface RemoteEntitiesManager (opensearch-project#14671)

* Create interface RemoteEntitiesManager

Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimise TransportNodesAction to not send DiscoveryNodes for NodeStat… (opensearch-project#14749)

* Optimize TransportNodesAction to not send DiscoveryNodes for NodeStats, NodesInfo and ClusterStats call

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Enabling term version check on local state for all ClusterManager Read Transport Actions (opensearch-project#14273)

* enabling term version check on local state for all admin read actions

Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Reduce logging in DEBUG for MasterService:run (opensearch-project#14795)

* Reduce logging in DEBUG for MasteService:run by introducing short and long summary in Taskbatcher

Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SplitResponseProcessor to Search Pipelines (opensearch-project#14800)

* Add SplitResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Register the split processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Avoid list copy by casting array

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add integration tests for RemoteRoutingTable Service. (opensearch-project#14631)

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add SortResponseProcessor to Search Pipelines (opensearch-project#14785)

* Add SortResponseProcessor for search pipelines

Signed-off-by: Daniel Widdis <[email protected]>

* Add stupid and unnecessary javadocs to satisfy overly strict CI

Signed-off-by: Daniel Widdis <[email protected]>

* Split casting and sorting methods for readability

Signed-off-by: Daniel Widdis <[email protected]>

* Register the sort processor factory

Signed-off-by: Daniel Widdis <[email protected]>

* Address code review comments

Signed-off-by: Daniel Widdis <[email protected]>

* Cast individual list elements to avoid creating two lists

Signed-off-by: Daniel Widdis <[email protected]>

* Add yamlRestTests

Signed-off-by: Daniel Widdis <[email protected]>

* Clarify why there's unusual sorting

Signed-off-by: Daniel Widdis <[email protected]>

* Use instanceof instead of isAssignableFrom

Signed-off-by: Daniel Widdis <[email protected]>

---------

Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix allowUnmappedFields, mapUnmappedFieldAsString settings to be applied when parsing query string query (opensearch-project#13957)

* Modify to invoke QueryShardContext.fieldMapper() method to apply allowUnmappedFields and mapUnmappedFieldAsString settings

Signed-off-by: imyp92 <[email protected]>

* Add test cases to verify returning 400 responses if unmapped fields are included for some types of query

Signed-off-by: imyp92 <[email protected]>

* Add changelog

Signed-off-by: imyp92 <[email protected]>

---------

Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.microsoft.azure:msal4j from 1.16.0 to 1.16.1 in /plugins/repository-azure (opensearch-project#14857)

* Bump com.microsoft.azure:msal4j in /plugins/repository-azure

Bumps [com.microsoft.azure:msal4j](https://github.com/AzureAD/microsoft-authentication-library-for-java) from 1.16.0 to 1.16.1.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-java/releases)
- [Changelog](https://github.com/AzureAD/microsoft-authentication-library-for-java/blob/dev/changelog.txt)
- [Commits](AzureAD/microsoft-authentication-library-for-java@v1.16.0...v1.16.1)

---
updated-dependencies:
- dependency-name: com.microsoft.azure:msal4j
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Updating SHAs

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump com.gradle.develocity from 3.17.5 to 3.17.6 (opensearch-project#14856)

* Bump com.gradle.develocity from 3.17.5 to 3.17.6

Bumps com.gradle.develocity from 3.17.5 to 3.17.6.

---
updated-dependencies:
- dependency-name: com.gradle.develocity
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump org.jline:jline in /test/fixtures/hdfs-fixture (opensearch-project#14859)

Bumps [org.jline:jline](https://github.com/jline/jline3) from 3.26.2 to 3.26.3.
- [Release notes](https://github.com/jline/jline3/releases)
- [Changelog](https://github.com/jline/jline3/blob/master/changelog.md)
- [Commits](jline/jline3@jline-parent-3.26.2...jline-parent-3.26.3)

---
updated-dependencies:
- dependency-name: org.jline:jline
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use Lucene provided Persian stem (opensearch-project#14847)

Lucene provided Persian stem apparently isn't hooked yet and this change is
doing that based on what is done for Arabic stem support.

Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Bump actions/checkout from 2 to 4 (opensearch-project#14858)

* Bump actions/checkout from 2 to 4

Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 4.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2...v4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Signed-off-by: Kaushal Kumar <[email protected]>

* Deprecate batch_size parameter on bulk API (opensearch-project#14725)

By default the full _bulk payload will be passed to ingest processors as a
batch, with any sub batching logic to be implemented by each processor if
necessary.

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Add perms for remote snapshot cache eviction on scripted query (opensearch-project#14411)

Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add transport interceptor to populate queryGroupId in task headers

Signed-off-by: Kaushal Kumar <[email protected]>

* Add rest, transport layer changes for Hot to warm tiering - dedicated setup (opensearch-project#13980)

Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Create listener to refresh search thread resource usage (opensearch-project#14832)

* [bug fix] fix incorrect coordinator node search resource usages

Signed-off-by: Chenyang Ji <[email protected]>

* fix bug on serialization when passing task resource usage to coordinator

Signed-off-by: Chenyang Ji <[email protected]>

* add more unit tests

Signed-off-by: Chenyang Ji <[email protected]>

* remove query insights plugin related code

Signed-off-by: Chenyang Ji <[email protected]>

* create per request listener to refresh task resource usage

Signed-off-by: Chenyang Ji <[email protected]>

* Make new listener API public

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Add changelog

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Remove wrong files added

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Build fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make singleton

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Address review comments

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Make sure listener runs before plugin listeners

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Spotless

Signed-off-by: Siddhant Deshmukh <[email protected]>

* Minor fix

Signed-off-by: Siddhant Deshmukh <[email protected]>

---------

Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Caching avg total bytes and avg free bytes inside ClusterInfo (opensearch-project#14851)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Use default value when index.number_of_replicas is null (opensearch-project#14812)

* Use default value when index.number_of_replicas is null

Signed-off-by: Liyun Xiu <[email protected]>

* Add integration test

Signed-off-by: Liyun Xiu <[email protected]>

* Add changelog

Signed-off-by: Liyun Xiu <[email protected]>

---------

Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* [Remote Routing Table] Implement write and read flow for shard diff file. (opensearch-project#14684)

* Implement write and read flow to upload/download shard diff file.

Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optimized ClusterStatsIndices to precomute shard stats (opensearch-project#14426)

* Optimize Cluster Stats Indices to precomute node level stats

Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Fix constraint bug which allows more primary shards than average primary shards per index (opensearch-project#14908)

Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* Optmising AwarenessAllocationDecider for hashmap.get call (opensearch-project#14761)

Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* update comment

Signed-off-by: Kaushal Kumar <[email protected]>

* Fix IngestServiceTests.testBulkRequestExecutionWithFailures (opensearch-project#14918)

The test would previously fail if the randomness led to only a single
indexing request being included in the bulk payload. This change
guarantees multiple indexing requests in order to ensure the batch logic
kicks in.

Also replace some unneeded mocks with real classes.

Signed-off-by: Andrew Ross <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>

* add queryGroupTask

Signed-off-by: Kaushal Kumar <[email protected]>

* remove unnecessary imports

Signed-off-by: Kaushal Kumar <[email protected]>

* add QueryGroupTask tests

Signed-off-by: Kaushal Kumar <[email protected]>

* rename WLM transport request handler

Signed-off-by: Kaushal Kumar <[email protected]>

* add CHANGELOG entry

Signed-off-by: Kaushal Kumar <[email protected]>

* fix ut

Signed-off-by: Kaushal Kumar <[email protected]>

* address comments

Signed-off-by: Kaushal Kumar <[email protected]>

* fix UT to remove the verify for final method

Signed-off-by: Kaushal Kumar <[email protected]>

* apply spotless

Signed-off-by: Kaushal Kumar <[email protected]>

---------

Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Shivansh Arora <[email protected]>
Signed-off-by: Gao Binlong <[email protected]>
Signed-off-by: RS146BIJAY <[email protected]>
Signed-off-by: Chenyang Ji <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Sandesh Kumar <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Signed-off-by: Lukáš Vlček <[email protected]>
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: Swetha Guptha <[email protected]>
Signed-off-by: Sooraj Sinha <[email protected]>
Signed-off-by: ahmedsobeh <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Siddhant Deshmukh <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: vatsal <[email protected]>
Signed-off-by: Sachin Kale <[email protected]>
Signed-off-by: Shourya Dutta Biswas <[email protected]>
Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: mgodwan <[email protected]>
Signed-off-by: Mohit Godwani <[email protected]>
Signed-off-by: Sagar Upadhyaya <[email protected]>
Signed-off-by: Sandeep Kumawat <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Daniil Roman <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Rishabh Singh <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Signed-off-by: Ashish Singh <[email protected]>
Signed-off-by: bowenlan-amzn <[email protected]>
Signed-off-by: Pranshu Shukla <[email protected]>
Signed-off-by: Rajiv Kumar Vaidyanathan <[email protected]>
Signed-off-by: Sumit Bansal <[email protected]>
Signed-off-by: Daniel Widdis <[email protected]>
Signed-off-by: Shailendra Singh <[email protected]>
Signed-off-by: imyp92 <[email protected]>
Signed-off-by: gaobinlong <[email protected]>
Signed-off-by: Ebrahim Byagowi <[email protected]>
Signed-off-by: Liyun Xiu <[email protected]>
Signed-off-by: Finn Carroll <[email protected]>
Signed-off-by: Neetika Singhal <[email protected]>
Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: Gaurav Bafna <[email protected]>
Signed-off-by: Andrew Ross <[email protected]>
Co-authored-by: Shivansh Arora <[email protected]>
Co-authored-by: Arpit-Bandejiya <[email protected]>
Co-authored-by: gaobinlong <[email protected]>
Co-authored-by: rishavz_sagar <[email protected]>
Co-authored-by: Chenyang Ji <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Sandesh Kumar <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Lukáš Vlček <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: SwethaGuptha <[email protected]>
Co-authored-by: Sooraj Sinha <[email protected]>
Co-authored-by: Ahmed Sobeh <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddhant Deshmukh <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Vatsal <[email protected]>
Co-authored-by: Robin Friedmann <[email protected]>
Co-authored-by: Sachin Kale <[email protected]>
Co-authored-by: Bharathwaj G <[email protected]>
Co-authored-by: Shourya Dutta Biswas <[email protected]>
Co-authored-by: Craig Perkins <[email protected]>
Co-authored-by: Andriy Redko <[email protected]>
Co-authored-by: Mohit Godwani <[email protected]>
Co-authored-by: Sarthak Aggarwal <[email protected]>
Co-authored-by: Sagar <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Sandeep Kumawat <[email protected]>
Co-authored-by: Daniil Roman <[email protected]>
Co-authored-by: Rishabh Singh <[email protected]>
Co-authored-by: kkewwei <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Ashish Singh <[email protected]>
Co-authored-by: bowenlan-amzn <[email protected]>
Co-authored-by: Pranshu Shukla <[email protected]>
Co-authored-by: rajiv-kv <[email protected]>
Co-authored-by: Sumit Bansal <[email protected]>
Co-authored-by: Daniel Widdis <[email protected]>
Co-authored-by: shailendra0811 <[email protected]>
Co-authored-by: Park, Yeongwu <[email protected]>
Co-authored-by: ebraminio <[email protected]>
Co-authored-by: Liyun Xiu <[email protected]>
Co-authored-by: Finn <[email protected]>
Co-authored-by: Neetika Singhal <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Gaurav Bafna <[email protected]>
Co-authored-by: Andrew Ross <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.x Backport to 2.x branch skip-changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[TYPO] Fix typo in testFomXContentEmbeddedFoundParsingException method name
4 participants