Codesota · Models · Mistral-Small-24B-Instruct-2501Mistral9 results · 1 benchmarks
Model card

Mistral-Small-24B-Instruct-2501.

Mistralopen-source
§ 01 · Benchmarks

Every benchmark Mistral-Small-24B-Instruct-2501 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish MT-BenchNatural Language Processing · Polish Conversation Qualityextraction9.9%#1/50—source ↗
02Polish MT-BenchNatural Language Processing · Polish Conversation Qualitymath7.8%#4/50—source ↗
03Polish MT-BenchNatural Language Processing · Polish Conversation Qualitycoding8.0%#4/50—source ↗
04Polish MT-BenchNatural Language Processing · Polish Conversation Qualitypl-score8.7%#7/50—source ↗
05Polish MT-BenchNatural Language Processing · Polish Conversation Qualityreasoning7.9%#9/50—source ↗
06Polish MT-BenchNatural Language Processing · Polish Conversation Qualityroleplay9.1%#10/50—source ↗
07Polish MT-BenchNatural Language Processing · Polish Conversation Qualityhumanities9.7%#11/50—source ↗
08Polish MT-BenchNatural Language Processing · Polish Conversation Qualitystem9.5%#14/50—source ↗
09Polish MT-BenchNatural Language Processing · Polish Conversation Qualitywriting8.0%#24/50—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Mistral-Small-24B-Instruct-2501 actually performs.

Natural Language Processing
1
benchmark
avg rank #9.3
§ 04 · Related models

Other Mistral models scored on Codesota.

Mistral OCR 3
6 results
Codestral 22B
Unknown params · 2 results
Devstral 2
1 result
Devstral Small 2505
1 result
Mistral Large 3
123B params · 1 result
Mistral OCR 2
1 result
Mixtral-8x22b
1 result
Devstral Small
0 results
§ 05 · Sources & freshness

Where these numbers come from.

SpeakLeash/MT-Bench-PL
9
results
9 of 9 rows marked verified.