Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Spark Connector #3454

Closed
2 of 4 tasks
brijos opened this issue Mar 15, 2023 · 1 comment · Fixed by #4577
Closed
2 of 4 tasks

[DOC] Spark Connector #3454

brijos opened this issue Mar 15, 2023 · 1 comment · Fixed by #4577
Assignees
Labels
3 - Done Issue is done/complete Sev2 High-medium priority. Upcoming release or incorrect information. v2.9.0
Milestone

Comments

@brijos
Copy link

brijos commented Mar 15, 2023

What do you want to do?

  • Request a change to existing documentation
  • Add new documentation
  • Report a technical problem with the documentation
  • Other

Tell us about your request. Provide a summary of the request and all versions that are affected.
Introduce the ability to reach data at rest in an object store (e.g., S3 or data lake) via Spark (Spark to be supplied by the user). Our first release will focus on data stored in Parquet format. Users will be able to query this data as though it is regular OpenSearch data and visualize it alongside their OpenSearch data in OpenSearch Dashboards.

What other resources are available? Provide links to related issues, POCs, steps for testing, etc.
opensearch-project/opensearch-spark#4
opensearch-project/sql#1746

@Naarcha-AWS
Copy link
Collaborator

@brijos: do we have a timeline on when this should be complete.

@Naarcha-AWS Naarcha-AWS added 1 - Backlog Issue: The issue is unassigned or assigned but not started v-TBD Sev2 High-medium priority. Upcoming release or incorrect information. and removed untriaged labels Mar 29, 2023
@Naarcha-AWS Naarcha-AWS added v2.9.0 and removed v-TBD labels Jun 15, 2023
@Naarcha-AWS Naarcha-AWS added this to the v2.9 milestone Jun 15, 2023
@Naarcha-AWS Naarcha-AWS self-assigned this Jun 15, 2023
@brijos brijos changed the title [DOC] Data Source Connectivity Outside OpenSearch [DOC] Spark Connector Jun 15, 2023
@Naarcha-AWS Naarcha-AWS added 2 - In progress Issue/PR: The issue or PR is in progress. and removed 1 - Backlog Issue: The issue is unassigned or assigned but not started labels Jun 30, 2023
@hdhalter hdhalter added 3 - Done Issue is done/complete and removed 2 - In progress Issue/PR: The issue or PR is in progress. labels Jul 19, 2023
@vagimeli vagimeli mentioned this issue Oct 23, 2023
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Done Issue is done/complete Sev2 High-medium priority. Upcoming release or incorrect information. v2.9.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants