Codesota · Natural Language Processing · Machine Translation · DoTA (en->zh)Tasks/Natural Language Processing/Machine Translation
Machine Translation · benchmark dataset · EN

DoTA (Document image machine Translation dataset of ArXiv articles in markdown format).

DoTA (Document image machine Translation dataset of ArXiv articles in markdown format) is a large-scale dataset of document-image → translation pairs introduced for document image machine translation (DIMT). It was created from arXiv articles rendered in markdown format and is intended to evaluate translation of long-context, complex-layout document images (e.g., whole pages with tables/figures/sections) into markdown-formatted target text. The NAACL 2024 paper reports a filtered set of about 126K image–translation pairs; the authors also provide an unfiltered collection of ~139K samples in the public repository/dataset. The dataset includes multilingual content (source English and target Chinese for the en→zh subset used in evaluations; the dataset metadata indicates other language variants are present) and is distributed under an MIT license on Hugging Face (the Hugging Face dataset is gated and requires agreeing to access conditions).

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

1 result indexed across 1 metric. Shaded row marks current SOTA; ties broken by submission date.


Primary
COMET · higher is better
COMET· primary
1 row
#ModelOrgSubmittedPaper / codeCOMET
01HunyuanOCR (1B)Nov 2025HunyuanOCR Technical Report · code83.48
Fig 2 · Rows sorted by score within each metric. Shaded row marks SOTA. Dates reflect model or paper release where available, otherwise the date Codesota accessed the source.
§ 03 · Progress

1 steps
of state of the art.

Each row below marks a model that broke the previous record on COMET. Intermediate submissions are kept in the leaderboard above; only SOTA-setting entries are re-listed here.

Higher scores win. Each subsequent entry improved upon the previous best.

SOTA line · COMET
  1. Nov 24, 2025HunyuanOCR (1B)83.48
Fig 3 · SOTA-setting models only. 1 entries span Nov 2025 Nov 2025.
§ 04 · Literature

1 paper
tied to this benchmark.

Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.

  • HunyuanOCR Technical Report
    Hunyuan Vision TeamPengyuan LyuXingyu WanGengluo LiShangpin PengWeinong WangLiang WuHuawen ShenYu ZhouCanhui TangQi YangQiming PengBin LuoHower YangHouwen PengHongming YangSenhao XieBinghong WuMana YangSergey WangRaccoon LiuDick ZhuJie JiangLinusHan HuChengquan Zhang
    Nov 2025·HunyuanOCR (1B)
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies