Model card
Gemma-3-27b.
Googleopen-weights27B paramstransformer
Gemma 3 instruction-tuned, March 2025
§ 01 · Benchmarks
Every benchmark Gemma-3-27b has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | BIG-Bench Hard | Reasoning · Multi-step Reasoning | accuracy | 87.6% | #3 | — | source ↗ |
| 02 | MBPP | Computer Code · Code Generation | pass@1 | 74.4% | #14 | — | source ↗ |
| 03 | HumanEval | Computer Code · Code Generation | pass@1 | 87.8% | #25 | — | source ↗ |
| 04 | LiveCodeBench | Computer Code · Code Generation | pass@1 | 39.0% | #26 | — | source ↗ |
| 05 | PLCC | Natural Language Processing · Polish Cultural Competency | culture-and-tradition | 55.0% | #99 | — | source ↗ |
| 06 | PLCC | Natural Language Processing · Polish Cultural Competency | art-and-entertainment | 43.0% | #106 | — | source ↗ |
| 07 | PLCC | Natural Language Processing · Polish Cultural Competency | average | 47.3% | #121 | — | source ↗ |
| 08 | PLCC | Natural Language Processing · Polish Cultural Competency | vocabulary | 37.0% | #125 | — | source ↗ |
| 09 | PLCC | Natural Language Processing · Polish Cultural Competency | grammar | 46.0% | #126 | — | source ↗ |
| 10 | PLCC | Natural Language Processing · Polish Cultural Competency | geography | 51.0% | #130 | — | source ↗ |
| 11 | PLCC | Natural Language Processing · Polish Cultural Competency | history | 52.0% | #135 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where Gemma-3-27b actually performs.
§ 04 · Related models
Other Google models scored on Codesota.
Gemini 2.5 Pro
16 results · 3 SOTA
Gemini 3 Pro
Undisclosed params · 13 results · 2 SOTA
Gemini 1.5 Pro
12 results · 1 SOTA
Gemini 3.1 Pro
3 results · 1 SOTA
ViT-H/14
632M params · 2 results · 1 SOTA
CoCa (finetuned)
2.1B params · 1 result · 1 SOTA
Gemini 2.0 Flash
1 result · 1 SOTA
Gemini 3.1 Pro Preview
1 result · 1 SOTA
§ 05 · Sources & freshness
Where these numbers come from.
sdadas/PLCC
7
results
arxiv-2503.19786
3
results
llm-stats-bbh
1
result
11 of 11 rows marked verified.