Codesota · General · Vision-Language Models · AI2DTasks/General/Vision-Language Models
Vision-Language Models · benchmark dataset · EN

AI2D.

Dataset of ~5,000 diagrams with exhaustive annotations of diagram constituents and their relationships, together with about 15,000 question–answer pairs for diagram question answering. Introduced for studying diagram parsing and reasoning in “A Diagram Is Worth A Dozen Images” (Kembhavi et al., 2016).

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies