Codesota · Models · Gemma 3 (27B, IT)5 results · 5 benchmarks
Model card
Gemma 3 (27B, IT).
unknown
§ 02 · Benchmarks
Every benchmark Gemma 3 (27B, IT) has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | SimpleQA | Natural Language Processing · Question Answering | accuracy | 10.0% | #7 | — | source ↗ |
| 02 | MMMU | Multimodal · Visual Question Answering | accuracy | 64.9% | #18 | — | source ↗ |
| 03 | MMMU | Multimodal · Image-Text-to-Text | accuracy | 64.9% | #19 | — | source ↗ |
| 04 | LiveCodeBench | Computer Code · Code Generation | pass-1 | 29.7% | #24 | — | source ↗ |
| 05 | GPQA Diamond | Reasoning · Multi-step Reasoning | accuracy | 42.4% | #70 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Gemma 3 (27B, IT) actually performs.
§ 04 · Papers
1 paper with results for Gemma 3 (27B, IT).
- 2025-03-25· 5 results
Gemma 3 Technical Report
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
5
results
0 of 5 rows marked verified.