Codesota · General · Video-Language Models · MMWorldTasks/General/Video-Language Models
Video-Language Models · benchmark dataset · ENGLISH

MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos.

MMWorld is a comprehensive benchmark for evaluating multi-discipline multi-faceted world model evaluation in videos. It provides a curated collection of videos across multiple disciplines with questions that test various aspects of video understanding, including visual perception, domain knowledge, and reasoning capabilities. The dataset includes videos from different domains with structured questions and answers to evaluate Large Multimodal Models on their ability to understand and reason about video content.

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies