Codesota · Models · Qwen2.5-VL-72B15 results · 15 benchmarks
Model card
Qwen2.5-VL-72B.
unknown
§ 02 · Benchmarks
Every benchmark Qwen2.5-VL-72B has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | HumanEval+ | Computer Code · Code Generation | pass-1 | 87.8% | #2 | — | source ↗ |
| 02 | DocVQA | Computer Vision · Document Understanding | anls | 96.4% | #5 | — | source ↗ |
| 03 | MMBench | Multimodal · Visual Question Answering | accuracy | 88.6% | #7 | — | source ↗ |
| 04 | Video-MME | Multimodal · Video Understanding | accuracy | 79.1% | #8 | — | source ↗ |
| 05 | TextVQA | Multimodal · Visual Question Answering | accuracy | 83.5% | #9 | — | source ↗ |
| 06 | MVBench | Multimodal · Video Understanding | accuracy | 70.4% | #12 | — | source ↗ |
| 07 | RealWorldQA | Multimodal · Visual Question Answering | accuracy | 75.7% | #12 | — | source ↗ |
| 08 | MMStar | Multimodal · Image-Text-to-Text | accuracy | 70.8% | #14 | — | source ↗ |
| 09 | MMMU | Multimodal · Image-Text-to-Text | accuracy | 70.2% | #15 | — | source ↗ |
| 10 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 95.3% | #23 | — | source ↗ |
| 11 | MMMU-Pro | Multimodal · Visual Question Answering | accuracy | 51.1% | #24 | — | source ↗ |
| 12 | MATH | Reasoning · Mathematical Reasoning | accuracy | 83.0% | #26 | — | source ↗ |
| 13 | OSWorld | Agentic AI · Web & Desktop Agents | success-rate | 8.8% | #26 | — | source ↗ |
| 14 | MMLU-Pro | Reasoning · Commonsense Reasoning | accuracy | 71.2% | #61 | — | source ↗ |
| 15 | GPQA Diamond | Reasoning · Multi-step Reasoning | accuracy | 49.0% | #67 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Qwen2.5-VL-72B actually performs.
§ 04 · Papers
1 paper with results for Qwen2.5-VL-72B.
- 2025-02-19· 15 results
Qwen2.5-VL Technical Report
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
15
results
0 of 15 rows marked verified.