Codesota · Models · Mistral-Nemo-Instruct-2407mistralai14 results · 3 benchmarks
Model card

Mistral-Nemo-Instruct-2407.

mistralaiopen-source12.2B params
§ 01 · Benchmarks

Every benchmark Mistral-Nemo-Instruct-2407 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score61.8%#30/101—source ↗
02CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment3.6%#54/93—source ↗
03CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding3.3%#59/93—source ↗
04CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions2.1%#63/93—source ↗
05CPTU-BenchNatural Language Processing · Polish Text Understandingaverage2.9%#66/93—source ↗
06CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology2.7%#72/93—source ↗
07Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench45.2%#85/299—source ↗
08Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele86.6%#89/490—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage55.3%#98/491—source ↗
10Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk61.7%#101/489—source ↗
11Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in78.8%#115/490—source ↗
12Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book87.5%#131/489—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc73.3%#156/490—source ↗
14Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd28.4%#171/490—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Mistral-Nemo-Instruct-2407 actually performs.

Natural Language Processing
3
benchmarks
avg rank #92.1
§ 04 · Related models

Other mistralai models scored on Codesota.

Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-Instruct-v0.3
7.25B params · 0 results
Mistral-7B-v0.3
0 results
Mistral-Large-Instruct-2407
123B params · 0 results
Mistral-Large-Instruct-2411
123B params · 0 results
Mistral-Nemo-Base-2407
0 results
§ 05 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
8
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
14 of 14 rows marked verified.