General OCR Capabilities2024en
MME Video OCR Benchmark
1,464 videos with 2,000 QA pairs across 25 tasks. Tests OCR capabilities in video content.
Metrics:total-accuracy
Paper / WebsiteCurrent State of the Art
Gemini 2.5 Pro
73.7
total-accuracy
Top Models Performance Comparison
Top 6 models ranked by total-accuracy
Best Score
73.7
Top Model
Gemini 2.5 Pro
Models Compared
6
Score Range
12.7
total-accuracyPrimary
| # | Model | Score | Paper / Code | Date |
|---|---|---|---|---|
| 1 | Gemini 2.5 ProAPI Google | 73.7 | Dec 2025 | |
| 2 | Qwen2.5-VL 72BOpen Source Alibaba | 69 | Dec 2025 | |
| 3 | InternVL3-78BOpen Source Shanghai AI Lab | 67.2 | Dec 2025 | |
| 4 | GPT-4oAPI OpenAI | 66.4 | Dec 2025 | |
| 5 | Gemini 1.5 ProAPI Google | 64.9 | Dec 2025 | |
| 6 | Qwen2.5-VL 32BOpen Source Alibaba | 61 | Dec 2025 |