Code

Eval modalities#1

Code

Open

rrutmann wants to merge 10 commits intomasterModalities/lm-evaluation-harness:masterfrom eval_modalitiesModalities/lm-evaluation-harness:eval_modalitiesCopy head branch name to clipboard

+48-2

Commits

Commits on Feb 5, 2024

• feat: Add support for models from modalities

  rrutmann

  committed
  1f711cf

• test(eval): Test models from modalities

  rrutmann

  committed
  51a0cf5

• test(modalities): Pass max_length to greedy_until

  rrutmann

  committed
  b304f2d

Commits on Feb 19, 2024

• refactor(HF_test): Test greedy_until() for 20 tokens

  ajude2s

  committed
  1908cd8

Commits on Mar 4, 2024

• Update tests/test_models.py

  Show description for 5ef5928
  

  ajude2s

  and

  lllAlexanderlll

  authored
  5ef5928

• fix(eval): Using the array accessor instead

  ajude2s

  committed
  03b7c20

• Merge remote-tracking branch 'origin/eval_modalities' into eval_modalities

  ajude2s

  committed
  ba25e26

Commits on Jun 24, 2024

• feat(checkpointing):

  Show description for 7c5a9c0
  ajude2s

  committed
  7c5a9c0

Commits on Jun 25, 2024

• feat(Modalities): Adapted eval harness to be able to evaluate generic modalities models.

  ajude2s

  committed
  09dd787

Commits on Jul 8, 2024

• feat(DownstreamEval):

  Show description for bf873c6
  ajude2s

  committed
  bf873c6