A comprehensive benchmark for evaluating expert-level multi-discipline video understanding capabilities. MMVU provides 3,000 expert-annotated QA examples spanning 1,529 specialized-domain videos across 27 subjects in four key disciplines (Science, Healthcare, Humanities & Social Sciences, and Engineering). Each example comes with expert-annotated reasoning rationales and relevant domain knowledge, enabling researchers to assess not just answer correctness but also reasoning quality.
No results indexed yet — be the first to submit a score.
Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.