Model card
Mistral-Small-24B-Instruct-2501.
mistralaiopen-source23.6B params
§ 01 · Benchmarks
Every benchmark Mistral-Small-24B-Instruct-2501 has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polemo2-in | 87.7% | #9 | — | source ↗ |
| 02 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | belebele | 91.9% | #11 | — | source ↗ |
| 03 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | phraseology | 3.9% | #16 | — | source ↗ |
| 04 | Polish EQ-Bench | Natural Language Processing · Polish Emotional Intelligence | eq-score | 70.5% | #19 | — | source ↗ |
| 05 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | average | 3.7% | #27 | — | source ↗ |
| 06 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | tricky-questions | 3.4% | #27 | — | source ↗ |
| 07 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | sentiment | 3.9% | #34 | — | source ↗ |
| 08 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | dyk | 68.8% | #40 | — | source ↗ |
| 09 | CPTU-Bench | Natural Language Processing · Polish Text Understanding | language-understanding | 3.6% | #43 | — | source ↗ |
| 10 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | eq-bench | 55.6% | #50 | — | source ↗ |
| 11 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | average | 63.0% | #53 | — | source ↗ |
| 12 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | cbd | 35.1% | #55 | — | source ↗ |
| 13 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polqa-open-book | 88.1% | #108 | — | source ↗ |
| 14 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | ppc | 73.4% | #154 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where Mistral-Small-24B-Instruct-2501 actually performs.
§ 04 · Related models
Other mistralai models scored on Codesota.
Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-Instruct-v0.3
7.25B params · 0 results
Mistral-7B-v0.3
0 results
Mistral-Large-Instruct-2407
123B params · 0 results
Mistral-Large-Instruct-2411
123B params · 0 results
Mistral-Nemo-Base-2407
0 results
§ 05 · Sources & freshness
Where these numbers come from.
speakleash/open_pl_llm_leaderboard
8
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
14 of 14 rows marked verified.