Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speculative inference #590

Draft
wants to merge 10 commits into
base: main
Choose a base branch
from
Draft

Speculative inference #590

wants to merge 10 commits into from

Commits on Jul 2, 2024

  1. fix

    @xtinkt
    xtinkt committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    4285ddb View commit details
    Browse the repository at this point in the history

  2. fix

    @xtinkt
    xtinkt committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    b6801af View commit details
    Browse the repository at this point in the history

  3. fix

    @xtinkt
    xtinkt committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    de2c38a View commit details
    Browse the repository at this point in the history

  4. fix

    @xtinkt
    xtinkt committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    10de34b View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. fix

    @xtinkt
    xtinkt committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    7565dde View commit details
    Browse the repository at this point in the history

  2. fix

    @xtinkt
    xtinkt committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    269028d View commit details
    Browse the repository at this point in the history

  3. style

    @xtinkt
    xtinkt committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    9aecb3f View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. running inference session with position getter/setter (#594) 

    * Add option to rollback inference for a certain number of steps (#588)

* fix

* fix

* fix

* fix

* fix

* fix

* style

* test running inference session with position getter/setter

* add assertion

* fix typo

---------

Co-authored-by: Anton Sinitsin <[email protected]>
    @justheuristic @xtinkt
    justheuristic and xtinkt authored Jul 21, 2024
    Configuration menu
    Copy the full SHA
    a59e38a View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. Merge branch 'main' into speculative_inference

    @justheuristic
    justheuristic authored Sep 7, 2024
    Configuration menu
    Copy the full SHA
    1311191 View commit details
    Browse the repository at this point in the history

  2. black

    @justheuristic
    justheuristic committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    24efbeb View commit details
    Browse the repository at this point in the history