Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Mock Model + Test Directory #24

Merged
merged 40 commits into from
Nov 5, 2024
Merged

Adding Mock Model + Test Directory #24

merged 40 commits into from
Nov 5, 2024

Commits on Oct 24, 2024

  1. adding vLLM dockerfile

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    ee9be29 View commit details
    Browse the repository at this point in the history

  2. adding label GHCR and sed import edit for vllm server_example_tt.py

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    efe648b View commit details
    Browse the repository at this point in the history

  3. adding evals instructions and run script

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    0e5f431 View commit details
    Browse the repository at this point in the history

  4. move vllm llama 3.1 70b implementation to top level model impl dir

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    ffdd77a View commit details
    Browse the repository at this point in the history

  5. update eval instructions

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    5ef0d64 View commit details
    Browse the repository at this point in the history

  6. adding llama 3.1 70b benchmarking instructions

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    33340dc View commit details
    Browse the repository at this point in the history

  7. adding dir for locust

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    50626e4 View commit details
    Browse the repository at this point in the history

  8. add doc link for vllm setup

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    11c604a View commit details
    Browse the repository at this point in the history

  9. adding pre-commit with ruff linting and formatting

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    45f544d View commit details
    Browse the repository at this point in the history

  10. add pre-commit instructions

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    64281b0 View commit details
    Browse the repository at this point in the history

  11. add GHCR repo connection label to Dockerfile

    @tstescoTT
    tstescoTT committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    f9b4fb3 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. added mock model

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    663e090 View commit details
    Browse the repository at this point in the history

  2. created + add mock model and mock offline inference w/ patches

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    ca65d95 View commit details
    Browse the repository at this point in the history

  3. removed unneeded imports from mock model

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    b71e261 View commit details
    Browse the repository at this point in the history

  4. update python path to include vllm

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e8ab7a6 View commit details
    Browse the repository at this point in the history

  5. uncommetned sys path line

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    1a72731 View commit details
    Browse the repository at this point in the history

  6. update dockerfile to pip install for specifc commit of vllm

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    bb284db View commit details
    Browse the repository at this point in the history

  7. update readme mock instructions

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    9986877 View commit details
    Browse the repository at this point in the history

  8. update readme mock instructions

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    80138ce View commit details
    Browse the repository at this point in the history

  9. comments for mock patches

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    a03566e View commit details
    Browse the repository at this point in the history

  10. update mock to work with latest vllm commit 82dbca6

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    fb50708 View commit details
    Browse the repository at this point in the history

  11. remove tracing calls in mock model

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    ced6860 View commit details
    Browse the repository at this point in the history

  12. remove uneeded imports

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    0c7d005 View commit details
    Browse the repository at this point in the history

  13. remove checkout specfic commit

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    4f8e512 View commit details
    Browse the repository at this point in the history

  14. remove imports and comments

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    77e6699 View commit details
    Browse the repository at this point in the history

  15. cleanup

    @mvanniasingheTT
    mvanniasingheTT committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    bf2e08b View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. resolved conflict

    @mvanniasingheTT
    mvanniasingheTT committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    fda72f7 View commit details
    Browse the repository at this point in the history

  2. resolved conflict

    @mvanniasingheTT
    mvanniasingheTT committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    e9a9f54 View commit details
    Browse the repository at this point in the history

  3. update read me with clearer commit hash instructions

    @mvanniasingheTT
    mvanniasingheTT committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    66352f8 View commit details
    Browse the repository at this point in the history

  4. update read me with clearer commit hash instructions

    @mvanniasingheTT
    mvanniasingheTT committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    9b14371 View commit details
    Browse the repository at this point in the history

  5. Update tests/README.md 

    Co-authored-by: Milan Kordic <[email protected]>
    @mvanniasingheTT @milank94
    mvanniasingheTT and milank94 authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    1ee28bc View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Update tests/README.md 

    Co-authored-by: Milan Kordic <[email protected]>
    @mvanniasingheTT @milank94
    mvanniasingheTT and milank94 authored Nov 4, 2024
    Configuration menu
    Copy the full SHA
    61d872a View commit details
    Browse the repository at this point in the history

  2. Update tests/README.md 

    Co-authored-by: Milan Kordic <[email protected]>
    @mvanniasingheTT @milank94
    mvanniasingheTT and milank94 authored Nov 4, 2024
    Configuration menu
    Copy the full SHA
    f607fcb View commit details
    Browse the repository at this point in the history

  3. remove unused TtLlamaModel import

    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    ab44d3e View commit details
    Browse the repository at this point in the history

  4. Merge branch 'mvanniasinghe/mock_model' of https://github.com/tenstor… 

    …rent/tt-inference-server into mvanniasinghe/mock_model
    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    dd11f47 View commit details
    Browse the repository at this point in the history

  5. delete_trace should do nothing when called in mock, in worker it is a… 

    …lways set to call
    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    06c2188 View commit details
    Browse the repository at this point in the history

  6. update prefill forward call

    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    9ed760f View commit details
    Browse the repository at this point in the history

  7. added some comments about decode

    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    23d37ad View commit details
    Browse the repository at this point in the history

  8. renamed file by accident

    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    ce1893f View commit details
    Browse the repository at this point in the history

  9. ran ruff

    @mvanniasingheTT
    mvanniasingheTT committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    8b4afcc View commit details
    Browse the repository at this point in the history