o3 on ARC-AGI-1
- Model
- o3
- Benchmark
- ARC-AGI-1
- Metric
- accuracy
- Value
- 87.5
Verified o3 ARC-AGI-1 row.
Registry note: Public evaluation set (400 tasks). High-compute setting (900 samples/task). Source: ARC Prize leaderboard (Dec 2024).
Current registry values are resolved live when available and compared with the captured claim snapshot. Provenance remains visible when resolution falls back to the snapshot.
Verified o3 ARC-AGI-1 row.
Registry note: Public evaluation set (400 tasks). High-compute setting (900 samples/task). Source: ARC Prize leaderboard (Dec 2024).
Verified o4-mini ARC-AGI-1 row.
Registry note: Public evaluation set. Source: ARC Prize leaderboard (April 2025).
Verified Gemini 2.5 Pro ARC-AGI-1 row.
Registry note: Public evaluation set. Source: Gemini 2.5 Pro technical report (April 2025).
“CodeSOTA verified” means the evidence row and its source have passed the registry’s verification path. It does not, by itself, mean an independent team reran the protocol. Reproduction is recorded separately in the claim verdict and experiment graph.