GPQA
Unknown
448 expert-level questions in biology, physics, and chemistry. Designed to be unsearchable.
Benchmark Stats
Models4
Papers4
Metrics1
SOTA History
Coming SoonVisual timeline of state-of-the-art progression over time will appear here.
accuracy
accuracy
Higher is better
| Rank | Model | Code | Score | Paper / Source |
|---|---|---|---|---|
| 1 | o1-preview Graduate-level Google-Proof Q&A. PhD-level science questions. | - | 78 | openai-blog |
| 2 | claude-35-sonnet | - | 59.4 | anthropic-blog |
| 3 | gpt-4o | - | 53.6 | openai-blog |
| 4 | gemini-15-pro | - | 46.2 | google-blog |