Skip to content

Pull requests: open-compass/opencompass

New pull request New
26 Open 785 Closed
26 Open 785 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feature] Add Judgerbench and reorg subeval
#1593 opened Oct 9, 2024 by bittersweet1999 Loading…
6 tasks
@MaiziXiao
[Feature] Add GaoKaoMath Dataset for Evaluation & MATH Model Eval Config
#1589 opened Oct 8, 2024 by liushz Loading…
6 tasks
@liushz
[BUG] Fix lagent version for cibench
#1588 opened Oct 8, 2024 by kleinzcy Loading…
6 tasks
@liushz
[Feature] Support MMMLU & MMMLU-lite Benchmark
#1565 opened Sep 26, 2024 by BobTsang1995 Loading…
@acylam
13
Update TurboMindModel by integrating lmdeploy pipeline API
#1556 opened Sep 23, 2024 by lvhan028 Loading…
@bittersweet1999
3
[Update] Update Summarizer for Compassbench
#1555 opened Sep 23, 2024 by bittersweet1999 Loading…
6 tasks
@bittersweet1999
2
[Update] Update docs
#1534 opened Sep 18, 2024 by bittersweet1999 Loading…
6 tasks
@MaiziXiao
5
Add WMT19 dataset configuration and inference code
#1503 opened Sep 6, 2024 by cpa2001 Loading…
3 of 6 tasks
@tonysy
[Feature] Update octools CLI
#1496 opened Sep 6, 2024 by MaiziXiao Loading…
@tonysy
7
fix: IFEval dataset introduces the correct langdetect expectation path
#1451 opened Aug 23, 2024 by catohzs Loading…
@tonysy
1
[Feature] Add api_prompts to GenInferencerOutput
#1314 opened Jul 12, 2024 by xu-song Loading…
@tonysy
Add eval_benbench.py config
#1312 opened Jul 11, 2024 by Leymore Loading…
Add max_model_len when initializing VLLM engine
#1211 opened May 29, 2024 by xu-song Loading…
6 tasks done
@liushz
change max_task_size from CONSTANT value to DYNAMIC value
#1183 opened May 22, 2024 by disperaller Loading…
6 tasks
@liushz
Adding support for fireworks and vllm models and sample for wiki mode…
#1084 opened Apr 25, 2024 by arsh-orby Loading…
6 tasks
@kennymckormick
API-DEMO
#969 opened Mar 13, 2024 by TwT-JD Loading…
6 tasks done
@liushz
Update a MMLU dataset config with a more general post process
#790 opened Jan 11, 2024 by yitongYao Loading…
6 tasks
@kennymckormick
Support devops-eval
#762 opened Jan 3, 2024 by PanameraXXX Loading…
6 tasks
@yingfhu
1
[Feature] Add Codereval inference
#658 opened Dec 1, 2023 by jingmingzhuo Loading…
6 tasks
@tonysy
[SIG] add LogiQA dataset
#516 opened Oct 27, 2023 by KevinNuNu Loading…
6 tasks
@tonysy
[SIG] add HeadQA dataset
#513 opened Oct 27, 2023 by KevinNuNu • Draft
6 tasks
@tonysy
[SIG] add ethics dataset
#495 opened Oct 20, 2023 by KevinNuNu Loading…
6 tasks
@tonysy
Integrate pytorch poc python api
#490 opened Oct 19, 2023 by HIT-cwh Loading…
6 tasks
7
[Feat] Support Knowledge-based Retriever
#348 opened Sep 3, 2023 by zhangyikaii Loading…
6
[Refactor] refactor prompt viewer & output reference
#327 opened Aug 29, 2023 by Leymore • Draft
2
ProTip! Updated in the last three days: updated:>2024-10-08.