DerivedField: PR-2 Implementation for all supported types and DerivedField… #83
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
rishabhmaurya
force-pushed
the
derived-field-pr1
branch
from
8b61cd3 to
f71522a
Compare
rishabhmaurya
force-pushed
the
derived-field-pr2
branch
2 times, most recently
from
abc5f57 to
7c436a4
Compare
rishabhmaurya
force-pushed
the
derived-field-pr1
branch
from
2002c2c to
48b5680
Compare
rishabhmaurya
force-pushed
the
derived-field-pr2
branch
from
7c436a4 to
57156e0
Compare
rishabhmaurya
force-pushed
the
derived-field-pr1
branch
from
48b5680 to
beec404
Compare
rishabhmaurya
force-pushed
the
derived-field-pr2
branch
2 times, most recently
from
c92b5ad to
4ef8b90
Compare
rishabhmaurya
force-pushed
the
derived-field-pr1
branch
from
b90f5dd to
e6c7c63
Compare
rishabhmaurya
force-pushed
the
derived-field-pr2
branch
from
4ef8b90 to
c0bf2d7
Compare
* Make GetTermVersionAction internal GetTermVersion action has been added to check if cluster state needs to be updated as a performance improvement on all cluster state checks. The Authorization systems in the Security Plugin check all actions that do not start with `internal:` for permissions causing users without `cluster:monitor/*` permissions to start getting 403 exceptions. This change signals that this action does not require an authorization check by any security systems since it cannot be called via REST APIs. Signed-off-by: Peter Nied <[email protected]> * Move TermVerson action outside of admin/cluster namespace Signed-off-by: Peter Nied <[email protected]> --------- Signed-off-by: Peter Nied <[email protected]>
…project#12876) * Change from configureEach to all to resolve incompatibility Signed-off-by: Zelin Hao <[email protected]> * Update Changelog Signed-off-by: Zelin Hao <[email protected]> --------- Signed-off-by: Zelin Hao <[email protected]>
…#12895) Signed-off-by: Craig Perkins <[email protected]>
Signed-off-by: Andriy Redko <[email protected]>
…oject#12877) With this plugin enabled we see significant increase in memory usage. This is due to a static map that collects Span entries per write/replication request. Tests with higher counts of independent writes are at risk of running oom or experiencing slow down / warnings related to this. Disabled the plugin by default until this is resolved given it is still under FeatureFlag. Signed-off-by: Marc Handalian <[email protected]>
…rch-project#12746) First in a series of commits to support derived fields, a form of schema-on-read. This commit adds: 1. DerivedFieldScript factory: This script factory will be used to execute scripts defined against derived fields of any type. 2. DerivedFieldValueFetcher: The value fetcher contains logic to execute script and fetch the value in form of List<Object>. It expects DerivedFieldScript.LeafFactory as an input and sets the contract with consumer to call setNextReader() whenever a segment is switched. 3. DerivedFieldQuery: This query will be used by any of the derived fields. It expects an input query and DerivedFieldValueFetcher. It uses 2-phase iterator approach with approximation iterator set to match all docs. On a match, it creates a lucene MemoryIndex for a given doc, fetches the value of the derived field from _source using DerivedFieldValueFetcher and executes the input query against. --------- Signed-off-by: Rishabh Maurya <[email protected]>
…Type Signed-off-by: Rishabh Maurya <[email protected]>
Signed-off-by: Rishabh Maurya <[email protected]>
Signed-off-by: Rishabh Maurya <[email protected]>
rishabhmaurya
force-pushed
the
derived-field-pr2
branch
from
c0bf2d7 to
c1c687b
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Derived Field PR2 (against PR1)-
PR1 - opensearch-project#12746
Implementation for all supported types and
DerivedFieldType. We support following types -Related Issues
Resolves opensearch-project#12508
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.