Video-MMMU is a multi-modal, multi-disciplinary benchmark designed to assess Large Multimodal Models (LMMs) ability to acquire and utilize knowledge from videos. It features a curated collection of 300 expert-level videos and 900 human-annotated questions across six disciplines, evaluating knowledge acquisition through stage-aligned question-answer pairs: Perception, Comprehension, and Adaptation.
No results indexed yet — be the first to submit a score.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.