Model card
Gemini-3.1-Pro.
Googleapi4 current SOTA
Imported from https://raw.githubusercontent.com/GAIR-NLP/AcademiClaw/main/README.md
§ 02 · Benchmarks
Every benchmark Gemini-3.1-Pro has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | AcademiClaw | Agentic AI · Task agents | avg-time-sec | 822.00 | #1 | 2026-05-04 | source ↗ |
| 02 | AcademiClaw | Agentic AI · Task agents | avg-tokens-per-task-k | 2857.00 | #1 | 2026-05-04 | source ↗ |
| 03 | AcademiClaw | Agentic AI · Task agents | tool-calls-per-task | 57.0% | #1 | 2026-05-04 | source ↗ |
| 04 | MMMU-Pro | Multimodal · Visual Question Answering | accuracy | 82.0% | #1 | 2026-03-18 | source ↗ |
| 05 | AcademiClaw | Agentic AI · Task agents | pass | 43.8% | #3 | 2026-05-04 | source ↗ |
| 06 | React Native Evals | Mobile Development · React Native Code Generation | navigation-satisfaction | 94.4% | #4 | — | source ↗ |
| 07 | AcademiClaw | Agentic AI · Task agents | avg-score | 64.3% | #5 | 2026-05-04 | source ↗ |
| 08 | React Native Evals | Mobile Development · React Native Code Generation | async-state-satisfaction | 80.8% | #5 | — | source ↗ |
| 09 | React Native Evals | Mobile Development · React Native Code Generation | requirement-satisfaction | 78.9% | #5 | — | source ↗ |
| 10 | AcademiClaw | Agentic AI · Task agents | safety-score | 74.9% | #6 | 2026-05-04 | source ↗ |
| 11 | React Native Evals | Mobile Development · React Native Code Generation | animation-satisfaction | 64.2% | #6 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Gemini-3.1-Pro actually performs.
§ 04 · Papers
1 paper with results for Gemini-3.1-Pro.
- 2026-05-04· Agentic AI· 6 results
AcademiClaw: When Students Set Challenges for AI Agents
Junjie Yu, Pengrui Lu, Weiye Si, Hongliang Lu et al.
§ 05 · Related models
Other Google models scored on Codesota.
Gemini 2.5 Pro
16 results · 2 SOTA
Gemini 1.5 Pro
15 results · 1 SOTA
Gemini 3 Pro
Undisclosed params · 12 results · 1 SOTA
ViT-H/14
632M params · 2 results · 1 SOTA
CoCa (finetuned)
2.1B params · 1 result · 1 SOTA
Gemini 2.0 Flash
1 result · 1 SOTA
Noise2Music
Unknown params · 1 result · 1 SOTA
Gemini 3 Flash
Undisclosed params · 6 results
§ 06 · Sources & freshness
Where these numbers come from.
paper
6
results
Callstack Incubator
4
results
artificialanalysis.ai
1
result
11 of 11 rows marked verified. · first result 2026-03-18, latest 2026-05-04.