Codesota · Computer Vision · Image generation · TIIF-Bench miniTasks/Computer Vision/Image generation
Image generation · benchmark dataset · EN

TIIF-Bench (Text-to-Image Instruction Following Benchmark) — mini (compact evaluation subset).

TIIF-Bench (Text-to-Image Instruction Following Benchmark) is a benchmark introduced to systematically evaluate how well text-to-image (T2I) models interpret and follow detailed user instructions. The full TIIF-Bench (paper arXiv:2506.02161) organizes prompts across multiple concept pools and six compositional prompt dimensions (including new dedicated dimensions for text rendering and style control), provides concise and extended prompt variants, and proposes fine-grained evaluation metrics for alignment between textual instructions and generated images. The authors also publish the images generated by evaluated (proprietary) models on the Hugging Face Hub as A113NW3I/TIIF-Bench-Data. "TIIF-Bench mini" refers to the compact/specialized subset used by the authors for (faster) text-to-image instruction-following evaluation in their experiments (the full benchmark and released HF dataset are linked below).

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies