-
Notifications
You must be signed in to change notification settings - Fork 61
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Document new experimental ingestion streaming APIs (#584)
* Document new experimental ingestion streaming APIs Signed-off-by: Andriy Redko <[email protected]> * Address review comments Signed-off-by: Andriy Redko <[email protected]> * Address review comments and add tests Signed-off-by: Andriy Redko <[email protected]> * Fix version constraints for tests Signed-off-by: Andriy Redko <[email protected]> * Address code review comments Signed-off-by: Andriy Redko <[email protected]> * Add transport-reactor-netty4 plugin to 2.17.0+ test containers Signed-off-by: Andriy Redko <[email protected]> * Enable streaming tests for 2.17.0 only Signed-off-by: Andriy Redko <[email protected]> * Exclude Dockefile from the list of scenario files Signed-off-by: Andriy Redko <[email protected]> * Move tests from tests/default to tests/plugins for streaming Signed-off-by: Andriy Redko <[email protected]> --------- Signed-off-by: Andriy Redko <[email protected]>
- Loading branch information
Showing
13 changed files
with
392 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -2238,3 +2238,6 @@ components: | |
| required: | ||
| - reason | ||
| - status | ||
| BatchSize: | ||
| type: integer | ||
| format: int64 | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| ARG OPENSEARCH_DOCKER_HUB_PROJECT | ||
| ARG OPENSEARCH_VERSION | ||
| ARG OPENSEARCH_DOCKER_REF | ||
|
|
||
| FROM ${OPENSEARCH_DOCKER_HUB_PROJECT}/opensearch:${OPENSEARCH_VERSION}${OPENSEARCH_DOCKER_REF} | ||
| RUN ./bin/opensearch-plugin install -b transport-reactor-netty4 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,54 @@ | ||
| $schema: ../../../../../json_schemas/test_story.schema.yaml | ||
|
|
||
| description: Test bulk streaming endpoint. | ||
| epilogues: | ||
| - path: /books,movies | ||
| method: DELETE | ||
| status: [200, 404] | ||
| chapters: | ||
| - synopsis: Create an index. | ||
| version: '>= 2.17' | ||
| path: /_bulk/stream | ||
| method: POST | ||
| request: | ||
| content_type: application/x-ndjson | ||
| payload: | ||
| - {create: {_index: movies}} | ||
| - {director: Bennett Miller, title: Moneyball, year: 2011} | ||
| - synopsis: Delete document in an index. | ||
| version: '2.17' | ||
| path: /_bulk/stream | ||
| method: PUT | ||
| request: | ||
| content_type: application/x-ndjson | ||
| payload: | ||
| - {delete: {_index: movies, _id: invalid}} | ||
| response: | ||
| status: 200 | ||
| payload: | ||
| errors: false | ||
| items: | ||
| - delete: | ||
| _index: movies | ||
| _id: invalid | ||
| result: not_found | ||
| status: 404 | ||
| - synopsis: Bulk document CRUD. | ||
| version: '>= 2.17' | ||
| path: /_bulk/stream | ||
| method: POST | ||
| request: | ||
| content_type: application/x-ndjson | ||
| payload: | ||
| - {create: {_index: books, _id: book_1392214}} | ||
| - {author: Harper Lee, title: To Kill a Mockingbird, year: 1960} | ||
| - {update: {_index: books, _id: book_1392214}} | ||
| - {doc: {pages: 376}} | ||
| - {update: {_index: books, _id: book_1392214}} | ||
| - {doc: {pages: 376}, _source: true} | ||
| - {update: {_index: books, _id: book_1392214}} | ||
| - {script: {source: ctx._source.pages = 376;}} | ||
| - {update: {_index: books, _id: does_not_exist}} | ||
| - {script: {source: 'ctx.op = "none";'}, scripted_upsert: true, upsert: {pages: 375}} | ||
| - {delete: {_index: books, _id: book_1392214}} | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,18 @@ | ||
| version: '3' | ||
|
|
||
| services: | ||
| opensearch-cluster: | ||
| build: | ||
| context: . | ||
| args: | ||
| - OPENSEARCH_DOCKER_HUB_PROJECT=${OPENSEARCH_DOCKER_HUB_PROJECT:-opensearchproject} | ||
| - OPENSEARCH_DOCKER_REF=${OPENSEARCH_DOCKER_REF} | ||
| - OPENSEARCH_VERSION=${OPENSEARCH_VERSION:-latest} | ||
| ports: | ||
| - 9200:9200 | ||
| - 9600:9600 | ||
| environment: | ||
| - OPENSEARCH_INITIAL_ADMIN_PASSWORD=${OPENSEARCH_PASSWORD:-myStrongPassword123!} | ||
| - OPENSEARCH_JAVA_OPTS=${OPENSEARCH_JAVA_OPTS} | ||
| - discovery.type=single-node | ||
| - http.type=reactor-netty4-secure |
Oops, something went wrong.