Skip to content

Commit

Permalink
Fix test failure on Spark < 3.3.x
Browse files Browse the repository at this point in the history
  • Loading branch information
jlowe committed Jul 27, 2023
1 parent f729aef commit 7db8438
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions integration_tests/src/main/python/parquet_testing_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@
from data_gen import copy_and_update
from pathlib import Path
import pytest
from spark_session import is_before_spark_330
import warnings

_rebase_confs = {
Expand Down Expand Up @@ -62,6 +63,8 @@
"nested_structs.rust.parquet": "PySpark cannot handle year 52951",
"repeated_no_annotation.parquet": "https://github.com/NVIDIA/spark-rapids/issues/8631",
}
if is_before_spark_330():
_xfail_files["rle_boolean_encoding.parquet"] = "Spark CPU cannot decode V2 style RLE before 3.3.x"

def locate_parquet_testing_files():
"""
Expand Down

0 comments on commit 7db8438

Please sign in to comment.