Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Issues found by Spark UT Framework of RapidsParquetSchemaPruningSuite #11405

Open
1 of 7 tasks
Feng-Jiang28 opened this issue Aug 28, 2024 · 0 comments
Open
1 of 7 tasks
Labels
bug Something isn't working

Comments

@Feng-Jiang28
Copy link
Collaborator

Feng-Jiang28 commented Aug 28, 2024

Describe the bug
Spark UT Framework enabled RapidsParquetSchemaPruningSuite(#11366) with the following test cases explicitly excluded:

Since there are many cases failed, the list is so long I just exclude by prefix "Spark vectorized reader", "Non-vectorized reader", "Case-insensitive parser" and "Case-sensitive parser".

These excluded test cases needs further investigating!!!
Notice: Other test cases in this suite may pass with falling back!

Steps/Code to reproduce bug

  1. Compile everything with mvn -Dbuildver=330 install -DskipTests
  2. Pick a test case name in the above table
  3. Go to RapidsTestSettings and find the line starting with ".exclude" and containing the test case name, comment it out
  4. Run the Suite then you'll see one failed test case. E.g. mvn -nsu -Dbuildver=330 -pl tests -Dsuites="org.apache.spark.sql.rapids.suites.RapidsXXXSuite" test (replace RapidsXXXSuite with the right name in issue header). ALWAYS double check if your suite name coincide with in source code, as it may contain typos!

Expected behavior
The suite can pass without excluding any test case.

@Feng-Jiang28 Feng-Jiang28 added ? - Needs Triage Need team to review and classify bug Something isn't working labels Aug 28, 2024
@GaryShen2008 GaryShen2008 removed the ? - Needs Triage Need team to review and classify label Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants