Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Update cudf.pandas Parquet reading according to cudf-polars results #17225

Open
vyasr opened this issue Oct 31, 2024 · 0 comments
Open
Labels
feature request New feature or request

Comments

@vyasr
Copy link
Contributor

vyasr commented Oct 31, 2024

Based on our findings in #16944 we may want to update cudf.pandas to parametrize the chunked parquet reading accordingly, in particular by setting a new pass read limit. The exact value may need to be different based on 1) cudf.pandas generally targeting smaller GPUs and 2) cudf.pandas using UVM, so we may have to do some extra research and testing there.

@vyasr vyasr added the feature request New feature or request label Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
Status: In Progress
Development

No branches or pull requests

1 participant