Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG][SanityTest][0.5-nexus] Disable Fields Minus in grammar to avoid data correctness issue #731

Open
LantaoJin opened this issue Oct 3, 2024 · 1 comment
Labels
bug Something isn't working Lang:PPL Pipe Processing Language support

Comments

@LantaoJin
Copy link
Member

What is the bug?
The Fields Minus Command fields - <field list> has been supported from #698 which is required Spark 3.5.0+
But its grammar presented at the beginning of this repository created, which the - in fields - <field list> is ignored by default. So in branch 0.5-nexus whose spark version is 3.3.2 will cause data correctness issue (the command results equal to command fields + <field list>).

@LantaoJin LantaoJin added bug Something isn't working untriaged labels Oct 3, 2024
@LantaoJin LantaoJin changed the title [BUG][0.5-nexus] Disable Fields Minus in grammar to avoid data correctness issue. [BUG][0.5-nexus] Disable Fields Minus in grammar to avoid data correctness issue Oct 3, 2024
@LantaoJin LantaoJin changed the title [BUG][0.5-nexus] Disable Fields Minus in grammar to avoid data correctness issue [BUG][SanityTest][0.5-nexus] Disable Fields Minus in grammar to avoid data correctness issue Oct 3, 2024
@YANG-DB YANG-DB added the Lang:PPL Pipe Processing Language support label Oct 3, 2024
@dblock dblock removed the untriaged label Oct 21, 2024
@dblock
Copy link
Member

dblock commented Oct 21, 2024

[Catch All Triage - 1, 2]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Lang:PPL Pipe Processing Language support
Projects
None yet
Development

No branches or pull requests

3 participants