Model card
Qwen2-VL 72B.
Alibabaopen-sourceVision-Language Model1 current SOTA
Qwen2's large vision-language model.
§ 02 · Benchmarks
Every benchmark Qwen2-VL 72B has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | VQA v2.0 | Multimodal · Visual Question Answering | accuracy | 87.6% | #1 | 2024-09-18 | source ↗ |
| 02 | CC-OCR | Computer Vision · General OCR Capabilities | kie-f1 | 71.8% | #1 | — | source ↗ |
| 03 | CC-OCR | Computer Vision · General OCR Capabilities | document-parsing | 53.8% | #2 | — | source ↗ |
| 04 | CC-OCR | Computer Vision · General OCR Capabilities | multi-scene-f1 | 78.0% | #2 | — | source ↗ |
| 05 | DocVQA | Computer Vision · Document Understanding | anls | 96.5% | #2 | — | source ↗ |
| 06 | TextVQA | Multimodal · Visual Question Answering | accuracy | 85.5% | #2 | — | source ↗ |
| 07 | CC-OCR | Computer Vision · General OCR Capabilities | multilingual-f1 | 71.1% | #3 | — | source ↗ |
| 08 | TextVQA | Multimodal · Visual Question Answering | accuracy | 84.9% | #4 | 2024-09-18 | source ↗ |
| 09 | MMBench | Multimodal · Visual Question Answering | accuracy | 88.0% | #8 | 2024-09-18 | source ↗ |
| 10 | MMBench | Multimodal · Visual Question Answering | accuracy | 86.5% | #10 | — | source ↗ |
| 11 | RealWorldQA | Multimodal · Visual Question Answering | accuracy | 77.8% | #10 | — | source ↗ |
| 12 | MVBench | Multimodal · Video Understanding | accuracy | 73.6% | #11 | — | source ↗ |
| 13 | MMStar | Multimodal · Image-Text-to-Text | accuracy | 68.3% | #18 | — | source ↗ |
| 14 | Video-MME | Multimodal · Video Understanding | accuracy | 71.2% | #18 | — | source ↗ |
| 15 | MMMU | Multimodal · Visual Question Answering | accuracy | 64.5% | #19 | 2024-09-18 | source ↗ |
| 16 | MMMU | Multimodal · Visual Question Answering | accuracy | 64.5% | #19 | — | source ↗ |
| 17 | MMMU | Multimodal · Image-Text-to-Text | accuracy | 64.5% | #20 | — | source ↗ |
| 18 | MMMU-Pro | Multimodal · Visual Question Answering | accuracy | 46.2% | #26 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Qwen2-VL 72B actually performs.
§ 04 · Papers
2 papers with results for Qwen2-VL 72B.
- 2024-09-18· Multimodal· 4 results
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
- 2024-09-18· 10 results
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
§ 05 · Related models
Other Alibaba models scored on Codesota.
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
10
results
arxiv
4
results
alphaxiv-leaderboard
2
results
cc-ocr-paper
2
results
6 of 18 rows marked verified.