Codesota · Models · ibm-granite/granite-3.1-2b-instructibm-granite16 results · 2 benchmarks
Model card

ibm-granite/granite-3.1-2b-instruct.

ibm-graniteopen-weights2.53B params
§ 02 · Benchmarks

Every benchmark ibm-granite/granite-3.1-2b-instruct has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment3.1%#76/93—source ↗
02CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding2.2%#85/93—source ↗
03CPTU-BenchNatural Language Processing · Polish Text Understandingaverage1.9%#86/93—source ↗
04CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions0.6%#87/93—source ↗
05CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology1.9%#92/93—source ↗
06Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-mc42.5%#200/490—source ↗
07Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench13.2%#237/299—source ↗
08Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpoquad-open-book53.6%#242/337—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage32.7%#311/491—source ↗
10Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk40.3%#339/489—source ↗
11Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in68.4%#381/490—source ↗
12Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc47.2%#416/490—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele49.2%#422/490—source ↗
14Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-generative32.5%#425/489—source ↗
15Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book59.9%#460/489—source ↗
16Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd8.5%#488/490—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where ibm-granite/granite-3.1-2b-instruct actually performs.

Natural Language Processing
2
benchmarks
avg rank #271.7
§ 05 · Related models

Other ibm-granite models scored on Codesota.

granite-3.0-2b-base
0 results
granite-3.0-2b-instruct
0 results
granite-3.0-8b-instruct
0 results
granite-3.1-1b-a400m-instruct
0 results
granite-3.1-3b-a800m-base
0 results
granite-3.1-3b-a800m-instruct
0 results
granite-3.1-8b-instruct
0 results
§ 06 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
11
results
SpeakLeash/CPTU-Bench
5
results
16 of 16 rows marked verified.