-
Notifications
You must be signed in to change notification settings - Fork 244
Issues: stanford-crfm/helm
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add Gemini-1.5-Pro-002 and Gemini-1.5-Flash-002
additions
New models or scenarios
good first issue
Good for newcomers
models
#3021
opened Sep 25, 2024 by
yifanmai
Add MMLU-Pro
additions
New models or scenarios
good first issue
Good for newcomers
scenarios
#3018
opened Sep 24, 2024 by
yifanmai
Add GPQA scenario
additions
New models or scenarios
good first issue
Good for newcomers
scenarios
#3017
opened Sep 24, 2024 by
yifanmai
Help me understand the HELM Classic Leaderboard's missing results
user question
#2994
opened Sep 16, 2024 by
PaulJoeMaliakel
Add amazon bedrock 3p models to the model configuration.
user question
#2967
opened Sep 3, 2024 by
subhaviv
Incorrect scoring due to answer format mismatch in MMLU evaluation
user question
#2939
opened Aug 16, 2024 by
DerryChan
Add sorting/filtering functionality to predictions pages
frontend
Frontend issues
#2887
opened Aug 1, 2024 by
farzaank
Add metadata field to HELM predictions
enhancement
New feature or request
frontend
Frontend issues
#2886
opened Aug 1, 2024 by
farzaank
HEIMHumanEvalScenario requires permissions to download data from codalab
HEIM (Text2Image)
user question
#2865
opened Jul 30, 2024 by
slymane
Sort by correctness functionality on Predictions page in front end
#2783
opened Jun 29, 2024 by
farzaank
warning when on outdated site
frontend
Frontend issues
good first issue
Good for newcomers
help wanted
#2681
opened May 24, 2024 by
farzaank
Previous Next
ProTip!
Add no:assignee to see everything that’s not assigned.