Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add BytePairEncoder class to cuDF #13891

Merged
merged 123 commits into from
Nov 14, 2023

Commits on Aug 16, 2023

  1. Configuration menu
    Copy the full SHA
    c53c47b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0783939 View commit details
    Browse the repository at this point in the history
  3. nvbench experiment

    davidwendt committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    370086f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    7e0d32d View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2023

  1. Configuration menu
    Copy the full SHA
    4603bc9 View commit details
    Browse the repository at this point in the history
  2. fix merge conflicts

    davidwendt committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    5fff5e9 View commit details
    Browse the repository at this point in the history
  3. add separator parameter

    davidwendt committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    c167369 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5595818 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2023

  1. Configuration menu
    Copy the full SHA
    de059a2 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Configuration menu
    Copy the full SHA
    1803937 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ecb9b55 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2023

  1. Configuration menu
    Copy the full SHA
    84a7a25 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0423224 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2023

  1. Configuration menu
    Copy the full SHA
    2eccaaa View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c0f0447 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3400ce8 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2023

  1. Configuration menu
    Copy the full SHA
    03892a8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e6a0848 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    44a2340 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    54814bd View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2023

  1. Configuration menu
    Copy the full SHA
    14d87c2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a1735ac View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    69dad47 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Configuration menu
    Copy the full SHA
    15083ad View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d10e894 View commit details
    Browse the repository at this point in the history
  3. remove whitespace checks

    davidwendt committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    f392617 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    82055c6 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Configuration menu
    Copy the full SHA
    a508030 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fe81461 View commit details
    Browse the repository at this point in the history
  3. more efficient pair lookup

    davidwendt committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    cb02a25 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    721b5b2 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Configuration menu
    Copy the full SHA
    9eb6666 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. fix merge conflict

    davidwendt committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    3f0aaf4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fb11116 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ea4150d View commit details
    Browse the repository at this point in the history
  4. undo temp changes

    davidwendt committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    346b0cb View commit details
    Browse the repository at this point in the history
  5. use segmented reduce

    davidwendt committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    6ad4187 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    bfe9d9e View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    9999b84 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    2fe62a3 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    9ad9865 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Configuration menu
    Copy the full SHA
    d52ba46 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b0fed2b View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2023

  1. Configuration menu
    Copy the full SHA
    891af21 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. block per string

    davidwendt committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    511a076 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5be1216 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2023

  1. Configuration menu
    Copy the full SHA
    ddcf973 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fe85ad View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. Configuration menu
    Copy the full SHA
    b91c13f View commit details
    Browse the repository at this point in the history
  2. add rerank working memory

    davidwendt committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    56c967f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    11730bc View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Configuration menu
    Copy the full SHA
    ba638a3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3e7a233 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2023

  1. Configuration menu
    Copy the full SHA
    a716c02 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    038809f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    07ad295 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2023

  1. Configuration menu
    Copy the full SHA
    3924d70 View commit details
    Browse the repository at this point in the history
  2. fix merge conflict

    davidwendt committed Sep 19, 2023
    Configuration menu
    Copy the full SHA
    b14dcbc View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    fb90f87 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    4528e6f View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Configuration menu
    Copy the full SHA
    6b87144 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9d177a7 View commit details
    Browse the repository at this point in the history
  3. limit adjacent pair search

    davidwendt committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    5e27d5a View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    05a0b60 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2023

  1. Configuration menu
    Copy the full SHA
    4d1173b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ad32601 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    33f2bc7 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2023

  1. Configuration menu
    Copy the full SHA
    ef498c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Configuration menu
    Copy the full SHA
    66e42af View commit details
    Browse the repository at this point in the history
  2. fix merge conflict

    davidwendt committed Sep 25, 2023
    Configuration menu
    Copy the full SHA
    27af2a0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5d73279 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. Configuration menu
    Copy the full SHA
    dbb011f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6407245 View commit details
    Browse the repository at this point in the history
  3. fix replace bug

    davidwendt committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    75432d2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    66a10cf View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2023

  1. Configuration menu
    Copy the full SHA
    5aa4cff View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d3ca6a0 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Configuration menu
    Copy the full SHA
    1ce7df6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b3765cb View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Configuration menu
    Copy the full SHA
    92fea3f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c0aad86 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Configuration menu
    Copy the full SHA
    5a955ab View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    521cd1b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9ed9b98 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    32935b6 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. Configuration menu
    Copy the full SHA
    b978e01 View commit details
    Browse the repository at this point in the history
  2. remove re-rank re-init

    davidwendt committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    e158312 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5f54b37 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Configuration menu
    Copy the full SHA
    0f3bc94 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6e859c7 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Configuration menu
    Copy the full SHA
    747e10f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e2c08a8 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Configuration menu
    Copy the full SHA
    aaeea74 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Configuration menu
    Copy the full SHA
    1917b17 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b873e40 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    9cb3e64 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2023

  1. Configuration menu
    Copy the full SHA
    e8139a7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    50f80df View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2023

  1. Configuration menu
    Copy the full SHA
    10e197f View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. Configuration menu
    Copy the full SHA
    c3c20c9 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. fix tmp-offsets size

    davidwendt committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    3c2a866 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8b4e448 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ee8b3b7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    664b96a View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. Configuration menu
    Copy the full SHA
    a28305d View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. Configuration menu
    Copy the full SHA
    de945ab View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    40bd2ae View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f81d881 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1ca9147 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. Configuration menu
    Copy the full SHA
    6738159 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2d43098 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. fix merge conflicts

    davidwendt committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    544a8e8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f24ce09 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Configuration menu
    Copy the full SHA
    ecd2062 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Configuration menu
    Copy the full SHA
    36a331a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8d47d77 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    63624ea View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. Configuration menu
    Copy the full SHA
    6075435 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. Configuration menu
    Copy the full SHA
    b278d0f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    335beb1 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    65cc91d View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    333a812 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Configuration menu
    Copy the full SHA
    261385d View commit details
    Browse the repository at this point in the history