Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Attention projections (QKV, O) disaggregation #1436

Merged
merged 28 commits into from
Oct 9, 2024
Merged

Attention projections (QKV, O) disaggregation #1436

merged 28 commits into from
Oct 9, 2024

Commits on Sep 25, 2024

  1. merged attn-qkv-proj into peft. 

    commented out some alignment test, but should be equivalent to the oriinal test.
    @yingchen21
    yingchen21 authored and zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    80e4d3c View commit details
    Browse the repository at this point in the history

  2. restored and passed the alignement test

    @yingchen21
    yingchen21 authored and zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    d67c87b View commit details
    Browse the repository at this point in the history

  3. linting

    @goliaro
    goliaro authored and zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    e5cc9ba View commit details
    Browse the repository at this point in the history

  4. rebased onto inference

    @yingchen21
    yingchen21 authored and zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    50d9f38 View commit details
    Browse the repository at this point in the history

  5. Bug fixes, uploaded missing cpp implmentation

    @yingchen21
    yingchen21 authored and zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    0928bec View commit details
    Browse the repository at this point in the history

  6. Code cleanup

    zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    001422a View commit details
    Browse the repository at this point in the history

  7. clean up

    zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    e0ee241 View commit details
    Browse the repository at this point in the history

  8. fixed problem with mpt.

    zhihao committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    d1a1c8e View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Merge branch 'inference' into attn-qkv-proj

    @goliaro
    goliaro authored Sep 27, 2024
    Configuration menu
    Copy the full SHA
    8f4bc8b View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. update

    @sfc-gh-goliaro
    sfc-gh-goliaro committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    fbac32e View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2024

  1. llama3.1 support

    @sfc-gh-goliaro
    sfc-gh-goliaro committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    22aebb3 View commit details
    Browse the repository at this point in the history

  2. fix

    @sfc-gh-goliaro
    sfc-gh-goliaro committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    7848871 View commit details
    Browse the repository at this point in the history

  3. support llama3.2

    @sfc-gh-goliaro
    sfc-gh-goliaro committed Sep 29, 2024
    Configuration menu
    Copy the full SHA
    6bc1eab View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. fix opt bias?

    @goliaro
    goliaro committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    006ba61 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. opt alignment test stub

    @goliaro
    goliaro committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    d8c4942 View commit details
    Browse the repository at this point in the history

  2. fix bias

    @goliaro
    goliaro committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e778ffe View commit details
    Browse the repository at this point in the history

  3. update

    @goliaro
    goliaro committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    7ea8bd4 View commit details
    Browse the repository at this point in the history

  4. fix non-fusion opt

    @goliaro
    goliaro committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    cf85d60 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. update

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    50a1163 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    c8c454e View commit details
    Browse the repository at this point in the history

  3. cleanup

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    d795059 View commit details
    Browse the repository at this point in the history

  4. delete file

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    6ebd2e9 View commit details
    Browse the repository at this point in the history

  5. cleanup

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    214b6bc View commit details
    Browse the repository at this point in the history

  6. shellcheck

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    c5264c4 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'inference' into attn-qkv-proj

    @goliaro
    goliaro authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    342f6a8 View commit details
    Browse the repository at this point in the history

  8. hip cleanup

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    e7152ea View commit details
    Browse the repository at this point in the history

  9. fix

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    a710d6f View commit details
    Browse the repository at this point in the history

  10. hip fixes

    @goliaro
    goliaro committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    85a62a7 View commit details
    Browse the repository at this point in the history