Codesota · Models · mistralai/Mistral-Small-24B-Instruct-2501mistralai17 results · 3 benchmarks
Model card

mistralai/Mistral-Small-24B-Instruct-2501.

mistralaiopen-weights23.6B params
§ 02 · Benchmarks

Every benchmark mistralai/Mistral-Small-24B-Instruct-2501 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpoquad-open-book74.0%#2/337—source ↗
02Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in87.7%#9/490—source ↗
03Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele91.9%#11/490—source ↗
04CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology3.9%#16/93—source ↗
05Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score70.5%#19/101—source ↗
06CPTU-BenchNatural Language Processing · Polish Text Understandingaverage3.7%#27/93—source ↗
07CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions3.4%#27/93—source ↗
08CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment3.9%#34/93—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-generative56.0%#39/489—source ↗
10Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk68.8%#40/489—source ↗
11CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding3.6%#43/93—source ↗
12Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench55.6%#50/299—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage63.0%#53/491—source ↗
14Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd35.1%#55/490—source ↗
15Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-mc54.6%#61/490—source ↗
16Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book88.1%#108/489—source ↗
17Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc73.4%#154/490—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where mistralai/Mistral-Small-24B-Instruct-2501 actually performs.

Natural Language Processing
3
benchmarks
avg rank #44.0
§ 05 · Related models

Other mistralai models scored on Codesota.

Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-v0.3
0 results
Mistral-Nemo-Base-2407
0 results
Mistral-Small-24B-Base-2501
0 results
Mistral-Small-Instruct-2409
0 results
Mixtral-8x22B-v0.1
0 results
§ 06 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
11
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
17 of 17 rows marked verified.