Model card
Mistral-Nemo-Base-2407.
mistralaiopen-source
§ 01 · Benchmarks
Every benchmark Mistral-Nemo-Base-2407 has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polqa-open-book | 88.4% | #97 | — | source ↗ |
| 02 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | belebele | 85.0% | #99 | — | source ↗ |
| 03 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | average | 47.3% | #145 | — | source ↗ |
| 04 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | polemo2-in | 76.5% | #149 | — | source ↗ |
| 05 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | eq-bench | 20.1% | #204 | — | source ↗ |
| 06 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | dyk | 46.8% | #236 | — | source ↗ |
| 07 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | ppc | 66.6% | #267 | — | source ↗ |
| 08 | Open PL LLM Leaderboard | Natural Language Processing · Polish LLM General | cbd | 20.3% | #319 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where Mistral-Nemo-Base-2407 actually performs.
§ 04 · Related models
Other mistralai models scored on Codesota.
Ministral-8B-Instruct-2410
0 results
Mistral-7B-Instruct-v0.1
0 results
Mistral-7B-Instruct-v0.2
0 results
Mistral-7B-Instruct-v0.3
7.25B params · 0 results
Mistral-7B-v0.3
0 results
Mistral-Large-Instruct-2407
123B params · 0 results
Mistral-Large-Instruct-2411
123B params · 0 results
Mistral-Nemo-Instruct-2407
12.2B params · 0 results
§ 05 · Sources & freshness
Where these numbers come from.
speakleash/open_pl_llm_leaderboard
8
results
8 of 8 rows marked verified.