Codesota · Models · mistralai/Mistral-Nemo-Instruct-2407mistralai17 results · 3 benchmarks
Model card

mistralai/Mistral-Nemo-Instruct-2407.

mistralaiopen-weights12.2B params
§ 02 · Benchmarks

Every benchmark mistralai/Mistral-Nemo-Instruct-2407 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score61.8%#30/101—source ↗
02CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment3.6%#54/93—source ↗
03CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding3.3%#59/93—source ↗
04CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions2.1%#63/93—source ↗
05CPTU-BenchNatural Language Processing · Polish Text Understandingaverage2.9%#66/93—source ↗
06Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpoquad-open-book68.3%#68/337—source ↗
07CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology2.7%#72/93—source ↗
08Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench45.2%#85/299—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele86.6%#89/490—source ↗
10Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage55.3%#98/491—source ↗
11Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-generative51.9%#98/489—source ↗
12Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk61.7%#101/489—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in78.8%#115/490—source ↗
14Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book87.5%#131/489—source ↗
15Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-mc46.7%#153/490—source ↗
16Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc73.3%#156/490—source ↗
17Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd28.4%#171/490—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where mistralai/Mistral-Nemo-Instruct-2407 actually performs.

Natural Language Processing
3
benchmarks
avg rank #94.6
§ 05 · Related models

Other mistralai models scored on Codesota.

Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-v0.3
0 results
Mistral-Nemo-Base-2407
0 results
Mistral-Small-24B-Base-2501
0 results
Mistral-Small-Instruct-2409
0 results
Mixtral-8x22B-v0.1
0 results
§ 06 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
11
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
17 of 17 rows marked verified.