Codesota · Natural Language Processing · Language Modeling · MTbenchTasks/Natural Language Processing/Language Modeling
Language Modeling · benchmark dataset · EN

MT-Bench (Multi-Turn Benchmark).

MT-Bench (MT-bench / MT-Bench) is a multi-turn benchmark for evaluating the conversational and instruction-following abilities of large language model (LLM) chat assistants. It was introduced in the paper “Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena” (arXiv:2306.05685). MT-Bench is a collection of open-ended, multi-turn question/prompts designed to probe coherence, context maintenance, reasoning, and helpfulness in dialogue. The benchmark is commonly evaluated using a “LLM-as-a-judge” methodology (using strong LLMs such as GPT-4 to score/rank responses), which the authors show can achieve high agreement with human preferences. Public Hugging Face mirrors of the MT-Bench data (e.g., philschmid/mt-bench and lighteval/mt-bench) commonly expose an 80-item multi-turn set that is widely used for reporting a numeric MT-Bench score.

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

1 result indexed across 1 metric. Shaded row marks current SOTA; ties broken by submission date.


Primary
Score (1-10) · higher is better
Score (1-10)· primary
1 row
#ModelOrgSubmittedPaper / codeScore (1-10)
01Qwen2.5-72B-InstructDec 2024Qwen2.5 Technical Report · code9.35
Fig 2 · Rows sorted by score within each metric. Shaded row marks SOTA. Dates reflect model or paper release where available, otherwise the date Codesota accessed the source.
§ 03 · Progress

1 steps
of state of the art.

Each row below marks a model that broke the previous record on Score (1-10). Intermediate submissions are kept in the leaderboard above; only SOTA-setting entries are re-listed here.

Higher scores win. Each subsequent entry improved upon the previous best.

SOTA line · Score (1-10)
  1. Dec 19, 2024Qwen2.5-72B-Instruct9.35
Fig 3 · SOTA-setting models only. 1 entries span Dec 2024 Dec 2024.
§ 04 · Literature

1 paper
tied to this benchmark.

Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.

  • Qwen2.5 Technical Report
    Qwen:An YangBaosong YangBeichen ZhangBinyuan HuiBo ZhengBowen YuChengyuan LiDayiheng LiuFei HuangHaoran WeiHuan LinJian YangJianhong TuJianwei ZhangJianxin YangJiaxi YangJingren ZhouJunyang LinKai DangKeming LuKeqin BaoKexin YangLe YuMei LiMingfeng XuePei ZhangQin ZhuRui MenRunji LinTianHao LiTianyi TangTingyu XiaXingzhang RenXuancheng RenYang FanYang SuYichang ZhangYu WanYuqiong LiuZeyu CuiZhenru ZhangZihan Qiu
    Dec 2024·Qwen2.5-72B-Instruct
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies