Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve cudf::io::datasource::create(). #17115

Open
wants to merge 3 commits into
base: branch-24.12
Choose a base branch
from
Open

Improve cudf::io::datasource::create(). #17115

wants to merge 3 commits into from
+935 −25

Commits on Oct 24, 2024

  1. Implement improved cudf::io::datasource::create() functionality. 

    Introduce new `datasource_kind` and `datasource_params` data types, and
update the cudf::io::datasource::create() signature to allow
parameterized datasource creation.

Additionally, implement new datasources:

    - host_source: base class that does simple host-based pread() calls
    - odirect_source: derivation of above that uses O_DIRECT
    - kvikio_source: simple Kvikio-based class (that does not fall back
      to mmap)
    @tpn
    tpn committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    9b99d38 View commit details
    Browse the repository at this point in the history

  2. Fix PR feedback.

    @tpn
    tpn committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    1dcb443 View commit details
    Browse the repository at this point in the history

  3. Implement a simple GDS-backed data source that does not rely upon Kvi… 

    …kio.
    @tpn
    tpn committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    47bccc7 View commit details
    Browse the repository at this point in the history