Skip to content

Pull requests: stanford-crfm/helm

New pull request New
12 Open 2,177 Closed
12 Open 2,177 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add multiple annotators to Omni-MATH and rename shared modules
#3291 opened Jan 23, 2025 by liamjxu Loading…
3
Add Legal Opinion Sentiment Classification scenario
#3286 opened Jan 22, 2025 by yifanmai Loading…
4
Adding IMDB_PTBR Scenario
#3284 opened Jan 22, 2025 by thallysonjsa Loading…
Switch table_benchmark wikitq to use 1 shot instead of 5
#3280 opened Jan 21, 2025 by yifanmai Loading…
Use original instance IDs in IFEval
#3275 opened Jan 15, 2025 by yifanmai Loading…
MedHelm: Add VQA-RAD scenario and specs
#3246 opened Dec 24, 2024 by sashimono-san Loading…
4
MedHelm: Implement medcalc bench scenario, metrics and specs
#3207 opened Dec 11, 2024 by sashimono-san Loading…
10
IBM Enterprise Scenarios
#3064 opened Oct 16, 2024 by yifanmai • Draft
Initial contact center base scenario setup and added summarization scenario
#2569 opened Apr 12, 2024 by chuanw24 Loading…
5
Documentation: Evaluation run lifecycle
#2506 opened Mar 25, 2024 by yifanmai Loading…
11
Remove AdapterSpec from metrics
#2244 opened Jan 17, 2024 by yifanmai • Draft
9
Numeracy scenario update
#1978 opened Nov 2, 2023 by friedeggs Loading…
1
ProTip! What’s not been updated in a month: updated:<2024-12-24.