Reading-comprehension benchmark requiring arithmetic, counting, sorting, comparison, and other discrete reasoning over paragraphs.
5 results indexed across 1 metric. Shaded row marks current SOTA; ties broken by submission date.
| # | Model | Org | Submitted | Paper / code | f1 |
|---|---|---|---|---|---|
| 01 | MiniMax-Text-01 | MiniMax | Jan 2025 | MiniMax-01: Scaling Foundation Models with Lightning Att… · code | 87.80 |
| 02 | HRM-Text-1B | — | May 2026 | pwc-dump · code | 82.30 |
| 03 | ByT5 XXL | — | May 2021 | ByT5: Towards a token-free future with pre-trained byte-… · code | 80 |
| 04 | Apertus-70B-Instruct | — | Sep 2025 | Apertus: Democratizing Open and Compliant LLMs for Globa… · code | 50.80 |
| 05 | OLMo-2-7B-1124 (olmOCR-peS2o) | — | Feb 2025 | olmOCR: Unlocking Trillions of Tokens in PDFs with Visio… · code | 43.70 |
Each row below marks a model that broke the previous record on f1. Intermediate submissions are kept in the leaderboard above; only SOTA-setting entries are re-listed here.
Higher scores win. Each subsequent entry improved upon the previous best.
Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.