Model card
PLLuM-12B-chat.
PLLuMopen-source
§ 01 · Benchmarks
Every benchmark PLLuM-12B-chat has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | writing | 8.0% | #23 | — | source ↗ |
| 02 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | humanities | 9.3% | #24 | — | source ↗ |
| 03 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | stem | 8.0% | #32 | — | source ↗ |
| 04 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | reasoning | 3.9% | #35 | — | source ↗ |
| 05 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | pl-score | 5.8% | #35 | — | source ↗ |
| 06 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | extraction | 6.5% | #37 | — | source ↗ |
| 07 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | roleplay | 5.0% | #42 | — | source ↗ |
| 08 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | coding | 3.0% | #43 | — | source ↗ |
| 09 | Polish MT-Bench | Natural Language Processing · Polish Conversation Quality | math | 2.6% | #43 | — | source ↗ |
| 10 | PLCC | Natural Language Processing · Polish Cultural Competency | art-and-entertainment | 48.0% | #93 | — | source ↗ |
| 11 | PLCC | Natural Language Processing · Polish Cultural Competency | culture-and-tradition | 49.0% | #112 | — | source ↗ |
| 12 | PLCC | Natural Language Processing · Polish Cultural Competency | history | 61.0% | #117 | — | source ↗ |
| 13 | PLCC | Natural Language Processing · Polish Cultural Competency | average | 47.0% | #122 | — | source ↗ |
| 14 | PLCC | Natural Language Processing · Polish Cultural Competency | geography | 54.0% | #123 | — | source ↗ |
| 15 | PLCC | Natural Language Processing · Polish Cultural Competency | vocabulary | 33.0% | #143 | — | source ↗ |
| 16 | PLCC | Natural Language Processing · Polish Cultural Competency | grammar | 37.0% | #149 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where PLLuM-12B-chat actually performs.
§ 04 · Related models
Other PLLuM models scored on Codesota.
§ 05 · Sources & freshness
Where these numbers come from.
SpeakLeash/MT-Bench-PL
9
results
sdadas/PLCC
7
results
16 of 16 rows marked verified.