Model card
Qwen2.5-Plus.
Unknown
Imported from Papers with Code dump
§ 02 · Benchmarks
Every benchmark Qwen2.5-Plus has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Arena-Hard | Natural Language Processing · Language Modeling | Accuracy | 81.4% | #1 | — | source ↗ |
| 02 | GPQA | Natural Language Processing · Language Modeling | Accuracy | 49.7% | #1 | — | source ↗ |
| 03 | GSM8k | Natural Language Processing · Language Modeling | Accuracy | 96.0% | #1 | — | source ↗ |
| 04 | HumanEval | General · Coding Agents | Pass@1 | 87.8% | #1 | — | source ↗ |
| 05 | IFEval | Natural Language Processing · Language Modeling | Accuracy | 86.3% | #1 | — | source ↗ |
| 06 | Livebench | Natural Language Processing · Language Modeling | Accuracy | 54.6% | #1 | — | source ↗ |
| 07 | MATH | Natural Language Processing · Language Modeling | Accuracy | 84.7% | #1 | — | source ↗ |
| 08 | MMLU-Pro | Natural Language Processing · Language Modeling | Accuracy | 72.5% | #1 | — | source ↗ |
| 09 | MultiPL-E | General · Coding Agents | Pass@1 | 77.0% | #1 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Qwen2.5-Plus actually performs.
§ 04 · Papers
1 paper with results for Qwen2.5-Plus.
- 2024-12-19· Natural Language Processing· 9 results
Qwen2.5 Technical Report
Qwen, :, An Yang, Baosong Yang et al.
§ 05 · Related models
Other Unknown models scored on Codesota.
fglihai
Unknown params · 6 results · 1 SOTA
CLIP4STR-L
Unknown params · 1 result · 1 SOTA
USYD NLP_CS29-2
Unknown params · 6 results
Corner-based Region Proposals
Unknown params · 3 results
EAST + VGG16
Unknown params · 3 results
SSTD
Unknown params · 3 results
TextBoxes++_MS
Unknown params · 3 results
WordSup (VGG16-synth-coco)
Unknown params · 3 results
§ 06 · Sources & freshness
Where these numbers come from.
paper
9
results
0 of 9 rows marked verified.