Codesota · Computer Vision · OCR · olmOCR-BenchTasks/Computer Vision/OCR
OCR · benchmark dataset · 2025 · ENGLISH

olmOCR-Bench.

olmOCR-bench is an evaluation dataset of 1,403 PDF files designed to test how well Optical Character Recognition (OCR) systems can convert PDFs into clean markdown, especially preserving complex structures like tables, equations, and natural reading order. It's used in conjunction with the olmOCR toolkit, an open-source tool for accurate PDF-to-text conversion that uses a vision language model.

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies