Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Support extensions via Spark Conf #437

Closed
noCharger opened this issue Jul 19, 2024 · 0 comments
Closed

[FEATURE] Support extensions via Spark Conf #437

noCharger opened this issue Jul 19, 2024 · 0 comments
Assignees
Labels
0.5 enhancement New feature or request

Comments

@noCharger
Copy link
Collaborator

Is your feature request related to a problem?

Right now spark extensions are override in flint https://github.com/opensearch-project/opensearch-spark/blob/43b14f4d857a4cfb0a1410[…]tion/src/main/scala/org/apache/spark/sql/FlintJobExecutor.scala, which limits the ability to use other extensions, including native ones, in Flint.

What solution would you like?

The proposed solution is to make the current set of Spark extensions a default one, rather than overriding all extensions. This would allow other extensions, including native Spark extensions, to be used in Flint.

@noCharger noCharger added enhancement New feature or request untriaged labels Jul 19, 2024
@noCharger noCharger self-assigned this Jul 19, 2024
@noCharger noCharger added 0.5 and removed untriaged labels Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.5 enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant