Codesota · Models · Mistral-Small-24B-2501Mistral7 results · 1 benchmarks
Model card

Mistral-Small-24B-2501.

Mistralopen-source
§ 02 · Benchmarks

Every benchmark Mistral-Small-24B-2501 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment33.0%#129/165source ↗
02PLCCNatural Language Processing · Polish Cultural Competencygrammar45.0%#130/165source ↗
03PLCCNatural Language Processing · Polish Cultural Competencyvocabulary36.0%#132/165source ↗
04PLCCNatural Language Processing · Polish Cultural Competencyaverage39.0%#140/165source ↗
05PLCCNatural Language Processing · Polish Cultural Competencyhistory49.0%#141/165source ↗
06PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition29.0%#143/165source ↗
07PLCCNatural Language Processing · Polish Cultural Competencygeography42.0%#143/165source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where Mistral-Small-24B-2501 actually performs.

Natural Language Processing
1
benchmark
avg rank #136.9
§ 05 · Related models

Other Mistral models scored on Codesota.

Mixtral-8x22b
17 results
Mixtral-8x7b
16 results
Mistral-7B-Instruct-v0.2
9 results
Mistral-7B-Instruct-v0.3
9 results
Mistral-Large-Instruct-2407
9 results
Mistral-Nemo-Instruct-2407
9 results
Mistral-Small-24B-Instruct-2501
9 results
Mistral-Small-3.1-24B-Instruct-2503
9 results
§ 06 · Sources & freshness

Where these numbers come from.

sdadas/PLCC
7
results
7 of 7 rows marked verified.