Codesota · Models · mistralai/Mistral-Large-Instruct-2407mistralai17 results · 3 benchmarks
Model card

mistralai/Mistral-Large-Instruct-2407.

mistralaiopen-weights123B params
§ 02 · Benchmarks

Every benchmark mistralai/Mistral-Large-Instruct-2407 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score78.1%#1/101—source ↗
02Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk75.9%#2/489—source ↗
03Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage69.1%#3/491—source ↗
04Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-generative63.4%#3/489—source ↗
05Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-mc63.5%#4/490—source ↗
06Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele92.6%#4/490—source ↗
07Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in88.5%#5/490—source ↗
08Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpoquad-open-book73.7%#5/337—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench62.6%#14/299—source ↗
10CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding4.0%#15/93—source ↗
11CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment4.2%#15/93—source ↗
12CPTU-BenchNatural Language Processing · Polish Text Understandingaverage3.9%#15/93—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd38.7%#15/490—source ↗
14CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology3.9%#17/93—source ↗
15CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions3.6%#20/93—source ↗
16Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book90.6%#50/489—source ↗
17Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc77.5%#70/490—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where mistralai/Mistral-Large-Instruct-2407 actually performs.

Natural Language Processing
3
benchmarks
avg rank #15.2
§ 05 · Related models

Other mistralai models scored on Codesota.

Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-v0.3
0 results
Mistral-Nemo-Base-2407
0 results
Mistral-Small-24B-Base-2501
0 results
Mistral-Small-Instruct-2409
0 results
Mixtral-8x22B-v0.1
0 results
§ 06 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
11
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
17 of 17 rows marked verified.