Model card
o1-mini.
OpenAIapi
§ 02 · Benchmarks
Every benchmark o1-mini has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | HumanEval | Computer Code · Code Generation | pass@1 | 92.4% | #11 | — | source ↗ |
| 02 | MATH | Reasoning · Mathematical Reasoning | accuracy | 90.0% | #18 | — | source ↗ |
| 03 | MMLU | Reasoning · Commonsense Reasoning | accuracy | 85.2% | #45 | — | source ↗ |
| 04 | GPQA Diamond | Reasoning · Multi-step Reasoning | accuracy | 60.0% | #57 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where o1-mini actually performs.
§ 05 · Related models
Other OpenAI models scored on Codesota.
§ 06 · Sources & freshness
Where these numbers come from.
openai-simple-evals
4
results
0 of 4 rows marked verified.