Codesota · General · Vision-Language Models · A12DTasks/General/Vision-Language Models
Vision-Language Models · benchmark dataset · EN

AI2D (AI2 Diagrams Dataset) — “A Diagram Is Worth A Dozen Images”.

AI2D (often cited from the paper “A Diagram Is Worth A Dozen Images” by Kembhavi et al., arXiv:1603.07396) is a dataset of elementary-school–level science diagrams intended for diagram understanding, parsing and multi-modal reasoning. The dataset contains roughly 4.9K diagrams (reported as ~4,903 images) that have been densely annotated with their constituent elements and the semantic/structural relationships between them. The authors introduce a Diagram Parse Graph (DPG) representation to capture diagram components (e.g., diagram regions/figures, diagram text, arrows/lines) and the relations that connect them; the dataset has been used for diagram parsing, diagram question answering / visual reasoning over diagrams, and related vision–language research. The original paper (ECCV/ArXiv) describes the collection, annotation format and the DPG representation. — Key references: arXiv:1603.07396, AI2D dataset on Hugging Face (lmms-lab/ai2d).

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies