Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DuckDB doesn't support Parquet with the brotly compression method, but VulcanSQL terminal doesn't show any error #237

Open
cyyeh opened this issue Jul 13, 2023 · 0 comments
Assignees
Labels
needs-triage type/bug Something went wrong

Comments

@cyyeh
Copy link
Member

cyyeh commented Jul 13, 2023

Environment

  • Version:

    cli version: 0.6.0
    core version: 0.6.0
    build version: 0.6.0
    serve version: 0.6.0
    
  • OS: macOS with M1 chip

  • Nodejs: v16.20.0

What's wrong?

I have found that DuckDB(both the latest version and ours) as of now doesn't support the brotly compression method. However, while reading parquet files with the brotly compression method, VulcanSQL terminal doesn't show error message. If I execute the same SQL statement using DuckDB cli, I can see the error message, as shown below:

D select * from read_parquet('/Users/cyyeh/Desktop/vulcan-sql-examples/yelp-dataset-api/yelp_academic_dataset_business.parquet')
> ;
Error: Invalid Error: Unsupported compression codec "BROTLI". Supported options are uncompressed, gzip, snappy or zstd

What's the correct behavior?

VulcanSQL terminal show display the correct error message

Reproducing steps

Read parquet files with the brotly compression method
yelp_academic_dataset_business.parquet.zip

@cyyeh cyyeh added type/bug Something went wrong needs-triage labels Jul 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-triage type/bug Something went wrong
Projects
None yet
Development

No branches or pull requests

2 participants