Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable direct ingestion and production of Arrow scalars #14121

Merged
merged 59 commits into from
Sep 23, 2023
Merged

Enable direct ingestion and production of Arrow scalars #14121

merged 59 commits into from
Sep 23, 2023

Commits on Sep 14, 2023

  1. Initial version of scalar

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    3aa461f View commit details
    Browse the repository at this point in the history

  2. Implement basic scatter algorithm with Scalar

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1c4f990 View commit details
    Browse the repository at this point in the history

  3. Build DeviceScalar around pylibcudf.Scalar

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8ad8367 View commit details
    Browse the repository at this point in the history

  4. Fix some initialization

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c147972 View commit details
    Browse the repository at this point in the history

  5. Add missing no_gc_clear

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    0e5e5d3 View commit details
    Browse the repository at this point in the history

  6. Implement from_libcudf

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    e300884 View commit details
    Browse the repository at this point in the history

  7. Remove mr from DeviceScalar

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    4a2a436 View commit details
    Browse the repository at this point in the history

  8. Inline _set_value

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    abd5550 View commit details
    Browse the repository at this point in the history

  9. Add a comment

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    e8f6847 View commit details
    Browse the repository at this point in the history

  10. Implement from_arrow

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8360f80 View commit details
    Browse the repository at this point in the history

  11. Add to package

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8814772 View commit details
    Browse the repository at this point in the history

  12. Implement release for gpumemoryview

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    3a04947 View commit details
    Browse the repository at this point in the history

  13. Add proper constructor for scalar from pyarrow scalar

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    032adbb View commit details
    Browse the repository at this point in the history

  14. Construct pylibcudf.Scalar for numeric types

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    16f4528 View commit details
    Browse the repository at this point in the history

  15. Construct pylibcudf.Scalar for string types

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    b75949a View commit details
    Browse the repository at this point in the history

  16. Add comment

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    8d46046 View commit details
    Browse the repository at this point in the history

  17. Stop using reduction in favor of get_element

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    ce164a0 View commit details
    Browse the repository at this point in the history

  18. Move construction from pyarrow scalar to a factory

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    a8d8cb6 View commit details
    Browse the repository at this point in the history

  19. Implement from_arrow at the C level

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    3fd071e View commit details
    Browse the repository at this point in the history

  20. Enable datetime

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    33abe2b View commit details
    Browse the repository at this point in the history

  21. Enable timedeltas

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c6b595d View commit details
    Browse the repository at this point in the history

  22. Enable lists

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    ec4b510 View commit details
    Browse the repository at this point in the history

  23. Enable structs

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    636242b View commit details
    Browse the repository at this point in the history

  24. Make list and struct code paths more parallel

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    4c08dc3 View commit details
    Browse the repository at this point in the history

  25. Unify builders and use recursion for all paths

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    50bbdc0 View commit details
    Browse the repository at this point in the history

  26. Enable decimals

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    7b34df4 View commit details
    Browse the repository at this point in the history

  27. Some cleanup

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    392407f View commit details
    Browse the repository at this point in the history

  28. Combine nestrepl

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    f5def95 View commit details
    Browse the repository at this point in the history

  29. Unify constructor

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    16cef15 View commit details
    Browse the repository at this point in the history

  30. Copy to avoid overwriting inputs

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    edcca20 View commit details
    Browse the repository at this point in the history

  31. Add error check for nested null in scalar and fix test

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c81e158 View commit details
    Browse the repository at this point in the history

  32. Initial implementation of to_arrow

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    14b2f86 View commit details
    Browse the repository at this point in the history

  33. Add from_arrow_scalar to Cython API

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    cd80fe0 View commit details
    Browse the repository at this point in the history

  34. Add Python wrappers for to_arrow

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    5fffc4f View commit details
    Browse the repository at this point in the history

  35. Add pylibcudf converter

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    cb52d2b View commit details
    Browse the repository at this point in the history

  36. Fix bugs in impl

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    643d992 View commit details
    Browse the repository at this point in the history

  37. Make to_arrow work for all column types

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    309cdfa View commit details
    Browse the repository at this point in the history

  38. Add to_arrow overload for 32-bit decimal

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    4e4bc64 View commit details
    Browse the repository at this point in the history

  39. Add support for list/struct up to output field naming

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    c62c71b View commit details
    Browse the repository at this point in the history

  40. Fully implement metadata

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    d6eee4b View commit details
    Browse the repository at this point in the history

  41. Split up detail and public APIs

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1591bdb View commit details
    Browse the repository at this point in the history

  42. Add streams to public APIs

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    7fff56d View commit details
    Browse the repository at this point in the history

  43. Add tests of from_arrow

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    00050f6 View commit details
    Browse the repository at this point in the history

  44. Add tests of to_arrow

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    1c2570b View commit details
    Browse the repository at this point in the history

  45. Add stream tests and fix missing stream usage

    @vyasr
    vyasr committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    663fde0 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2023

  1. Also add stream tests for the table APIs

    @vyasr
    vyasr committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    cf30fef View commit details
    Browse the repository at this point in the history

  2. Revert Python changes

    @vyasr
    vyasr committed Sep 15, 2023
    Configuration menu
    Copy the full SHA
    49b2693 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Switch back to older implementation of writing decimal bytes directly… 

    … without needing intermediates
    @vyasr
    vyasr committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    9b7f240 View commit details
    Browse the repository at this point in the history

  2. Specify unroll

    @vyasr
    vyasr committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    3d4ac77 View commit details
    Browse the repository at this point in the history

  3. Remove unnecessary includes

    @vyasr
    vyasr committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    9311663 View commit details
    Browse the repository at this point in the history

  4. Pass in precision instead of computing

    @vyasr
    vyasr committed Sep 18, 2023
    Configuration menu
    Copy the full SHA
    4313212 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Merge remote-tracking branch 'origin/branch-23.10' into feat/libcudf_… 

    …scalar_to_arrow
    @vyasr
    vyasr committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    5f5a542 View commit details
    Browse the repository at this point in the history

  2. Address reviews

    @vyasr
    vyasr committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    2aade20 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2023

  1. Merge branch 'branch-23.10' into feat/libcudf_scalar_to_arrow

    @vyasr
    vyasr authored Sep 21, 2023
    Configuration menu
    Copy the full SHA
    f80f089 View commit details
    Browse the repository at this point in the history

  2. PR reviews

    @vyasr
    vyasr committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    37376e0 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/branch-23.10' into feat/libcudf_… 

    …scalar_to_arrow
    @vyasr
    vyasr committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    11d3d12 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Merge branch 'branch-23.10' into feat/libcudf_scalar_to_arrow

    @vyasr
    vyasr authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    a46db3f View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/branch-23.10' into feat/libcudf_… 

    …scalar_to_arrow
    @vyasr
    vyasr committed Sep 22, 2023
    Configuration menu
    Copy the full SHA
    e42f04d View commit details
    Browse the repository at this point in the history

  3. Update cpp/include/cudf/interop.hpp 

    Co-authored-by: Bradley Dice <[email protected]>
    @vyasr @bdice
    vyasr and bdice authored Sep 22, 2023
    Configuration menu
    Copy the full SHA
    637e0a4 View commit details
    Browse the repository at this point in the history