Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: use pyarrow for string functions #2616

Merged
merged 75 commits into from
Aug 8, 2023
Merged

feat: use pyarrow for string functions #2616

merged 75 commits into from
Aug 8, 2023

Commits on Aug 8, 2023

  1. First function is working: is_alnum.

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    f499f27 View commit details
    Browse the repository at this point in the history

  2. is_alpha

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    018b8e3 View commit details
    Browse the repository at this point in the history

  3. is_decimal

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    1d97c32 View commit details
    Browse the repository at this point in the history

  4. is_lower

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    f3d2075 View commit details
    Browse the repository at this point in the history

  5. is_digit

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    784dc68 View commit details
    Browse the repository at this point in the history

  6. is_numeric

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    73b346d View commit details
    Browse the repository at this point in the history

  7. is_printable

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    eff2dfe View commit details
    Browse the repository at this point in the history

  8. is_space

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    82b5a7b View commit details
    Browse the repository at this point in the history

  9. is_upper

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c8c669c View commit details
    Browse the repository at this point in the history

  10. is_title

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    b9f9868 View commit details
    Browse the repository at this point in the history

  11. is_ascii; done with string predicates

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    88709b2 View commit details
    Browse the repository at this point in the history

  12. capitalize

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    7a5463a View commit details
    Browse the repository at this point in the history

  13. lower

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    56cb0b1 View commit details
    Browse the repository at this point in the history

  14. upper

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    2c1fe11 View commit details
    Browse the repository at this point in the history

  15. upper

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    d7db042 View commit details
    Browse the repository at this point in the history

  16. title

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    951f9b9 View commit details
    Browse the repository at this point in the history

  17. T -> T operations on bytestrings should return bytestrings.

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    adab599 View commit details
    Browse the repository at this point in the history

  18. repeat (the first that needs a broadcastable argument)

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    8279fde View commit details
    Browse the repository at this point in the history

  19. reverse (because it's easy)

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    4c41240 View commit details
    Browse the repository at this point in the history

  20. replace_slice

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    42604f0 View commit details
    Browse the repository at this point in the history

  21. replace_substring

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    b69d7a2 View commit details
    Browse the repository at this point in the history

  22. Also test 'max_replacements' in replace_substring.

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    3d825aa View commit details
    Browse the repository at this point in the history

  23. replace_substring_regex: done with string transforms

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    983c3ba View commit details
    Browse the repository at this point in the history

  24. center

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    bb8e8d7 View commit details
    Browse the repository at this point in the history

  25. lpad and rpad

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    fa5d0bc View commit details
    Browse the repository at this point in the history

  26. trim

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    99c4ce0 View commit details
    Browse the repository at this point in the history

  27. trim_whitespace

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    d713670 View commit details
    Browse the repository at this point in the history

  28. ltrim

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    e63bd3e View commit details
    Browse the repository at this point in the history

  29. rtrim

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    3040c4e View commit details
    Browse the repository at this point in the history

  30. rtrim_whitespace

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    6320f2e View commit details
    Browse the repository at this point in the history

  31. ltrim_whitespace

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    3d0998b View commit details
    Browse the repository at this point in the history

  32. slice

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    e624ee3 View commit details
    Browse the repository at this point in the history

  33. feat: add split_whitespace

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    766c9df View commit details
    Browse the repository at this point in the history

  34. test: add test for split_whitespace

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c25a558 View commit details
    Browse the repository at this point in the history

  35. test: correct test

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ddc9bc7 View commit details
    Browse the repository at this point in the history

  36. feat: add split_pattern

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    5638a79 View commit details
    Browse the repository at this point in the history

  37. refactor: rename _get_action

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    3ef7ded View commit details
    Browse the repository at this point in the history

  38. feat: add ak_split_pattern_regex

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    65d2166 View commit details
    Browse the repository at this point in the history

  39. test: update tests for new features

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    0e26798 View commit details
    Browse the repository at this point in the history

  40. Fixed UnmaskedArray._drop_none.

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    5ec706c View commit details
    Browse the repository at this point in the history

  41. fix: adjust for numexpr 2.8.5, which hid getContext's frame_depth arg… 

    …ument (#2617)
    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    bd8e2e6 View commit details
    Browse the repository at this point in the history

  42. extract_regex.

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    73c8121 View commit details
    Browse the repository at this point in the history

  43. join (almost entirely from https://gist.github.com/agoose77/28e5bb025… 

    …0678e454356a85861a16368)
    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    dc0746c View commit details
    Browse the repository at this point in the history

  44. use dispatch correctly

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    43aa272 View commit details
    Browse the repository at this point in the history

  45. fix: drop unused arg

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    cbf1577 View commit details
    Browse the repository at this point in the history

  46. join_element_wise

    @jpivarski @agoose77
    jpivarski authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    068b6af View commit details
    Browse the repository at this point in the history

  47. Revert "use dispatch correctly" 

    This reverts commit 559073b.
    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ffeef7b View commit details
    Browse the repository at this point in the history

  48. fix: broadcast num_repeats

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    19c7197 View commit details
    Browse the repository at this point in the history

  49. feat: add count_substring[_pattern]

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    21973bd View commit details
    Browse the repository at this point in the history

  50. docs: fixup docstring

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    d385e61 View commit details
    Browse the repository at this point in the history

  51. feat: add ends_with

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c9164d5 View commit details
    Browse the repository at this point in the history

  52. feat: add starts_with

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    aac5e8a View commit details
    Browse the repository at this point in the history

  53. docs: fix link

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    17a6a0e View commit details
    Browse the repository at this point in the history

  54. feat: add find_substring

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    83f1597 View commit details
    Browse the repository at this point in the history

  55. docs: fix typo

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    6ad578f View commit details
    Browse the repository at this point in the history

  56. feat: add find_substring_regex

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    3141ebb View commit details
    Browse the repository at this point in the history

  57. docs: fix link

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    4c69e86 View commit details
    Browse the repository at this point in the history

  58. feat: add match_like

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    8e230f4 View commit details
    Browse the repository at this point in the history

  59. test: improve test

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c676fbd View commit details
    Browse the repository at this point in the history

  60. feat: add match_substring, match_substring_regex

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    99584ba View commit details
    Browse the repository at this point in the history

  61. feat: add is_in and index_in

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c456b44 View commit details
    Browse the repository at this point in the history

  62. fix: operate at leaf depth

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    88f45cc View commit details
    Browse the repository at this point in the history

  63. refactor: add internal pyarrow.compute helper

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    6745ba2 View commit details
    Browse the repository at this point in the history

  64. refactor: use pyarrow import helper

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    4422ad8 View commit details
    Browse the repository at this point in the history

  65. refactor: add module and name arguments to high_level_function

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    ec6cefa View commit details
    Browse the repository at this point in the history

  66. fix: pass module to str high_level_function

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    307a3ea View commit details
    Browse the repository at this point in the history

  67. docs: homogenize docstrings

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    51a5c5c View commit details
    Browse the repository at this point in the history

  68. docs: add see also

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    447cde7 View commit details
    Browse the repository at this point in the history

  69. docs: include ak.str in toctree

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    cbba554 View commit details
    Browse the repository at this point in the history

  70. chore: update pre-commit hooks (#2619) 

    Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
    @pre-commit-ci @agoose77
    pre-commit-ci[bot] authored and agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    6e39bf1 View commit details
    Browse the repository at this point in the history

  71. refactor: cleanup error handling

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    9fee3fc View commit details
    Browse the repository at this point in the history

  72. Merge branch 'main' into jpivarski/use-pyarrow-for-strings

    @jpivarski
    jpivarski authored Aug 8, 2023
    Configuration menu
    Copy the full SHA
    a2ca690 View commit details
    Browse the repository at this point in the history

  73. Rename ak_*.py modules -> akstr_*.py.

    @jpivarski
    jpivarski committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    c5f5cb7 View commit details
    Browse the repository at this point in the history

  74. docs: be explicit about ak_str_

    @agoose77
    agoose77 committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    7bcb12c View commit details
    Browse the repository at this point in the history

  75. Merge branch 'main' into jpivarski/use-pyarrow-for-strings

    @agoose77
    agoose77 authored Aug 8, 2023
    Configuration menu
    Copy the full SHA
    34d0184 View commit details
    Browse the repository at this point in the history