Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MetricCountSeqAndTokens counst tokens in label (if exist) + improving epoch metrics print #352

Merged
merged 8 commits into from
May 23, 2024
Merged

MetricCountSeqAndTokens counst tokens in label (if exist) + improving epoch metrics print #352

merged 8 commits into from
May 23, 2024

Commits on May 7, 2024

  1. 1. add optional decoder_input to MetricCountSeqAndTokens 

    2. print traceback before throw - helps in debugging
3. modify epoch stats printing - each column has its own (fixed) width
    @michalozeryflato
    michalozeryflato committed May 7, 2024
    Configuration menu
    Copy the full SHA
    a6429ab View commit details
    Browse the repository at this point in the history

  2. addressing Sagi's comments

    @michalozeryflato
    michalozeryflato committed May 7, 2024
    Configuration menu
    Copy the full SHA
    f1f36a3 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Merge branch 'master' into support_ul2

    @michalozeryflato
    michalozeryflato committed May 14, 2024
    Configuration menu
    Copy the full SHA
    b0a3a56 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Merge branch 'master' into support_ul2

    @michalozeryflato
    michalozeryflato committed May 17, 2024
    Configuration menu
    Copy the full SHA
    df0cf14 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. improve _perplexity_update: to consume less GPU memory. 

    Note that the previous command preds[:, target] created a matrix of size [n,n].
Another simple alternative is
preds[torch.arange(preds.shape[0]), target]
    @michalozeryflato
    michalozeryflato committed May 23, 2024
    Configuration menu
    Copy the full SHA
    0553d82 View commit details
    Browse the repository at this point in the history

  2. fix a typo in the documentation

    @michalozeryflato
    michalozeryflato committed May 23, 2024
    Configuration menu
    Copy the full SHA
    1dabbea View commit details
    Browse the repository at this point in the history

  3. fix exceptions in _perplexity_update - caught by the test code!!

    @michalozeryflato
    michalozeryflato committed May 23, 2024
    Configuration menu
    Copy the full SHA
    2087bdb View commit details
    Browse the repository at this point in the history

  4. revert back to reshape

    @michalozeryflato
    michalozeryflato committed May 23, 2024
    Configuration menu
    Copy the full SHA
    34d4d8a View commit details
    Browse the repository at this point in the history