Codesota · Papers2026-01-01 · arXiv
Paper
Collider-Bench: Benchmarking AI Agents with Particle Physics Analysis Reproduction
Darius A. Faroughy, Sofia Palacios Schweitzer, Ian Pang, Siddharth Mishra-Sharma, David Shih
Collider-Bench is a benchmark for evaluating autonomous LLM agents on long-horizon, real-world scientific tasks involving the reproduction of Large Hadron Collider (LHC) experimental analyses.
Agents must turn published papers into executable simulation-and-selection pipelines to predict collision event yields, evaluated against quantitative targets.
§ 01 · Benchmark results
6 results reproduced from this paper.
View:
Sorted instantly in-page
Results
6
SOTA rows
1
Models
6
Datasets
1
| # | Model | Vendor | Benchmark | Value | SOTA | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Codex CLI (GPT-5.5) | OpenAI | Collider-Bench | 30.00 | #1 | — | source ↗ |
| 02 | Claude Code (Opus 4.7) | Anthropic | Collider-Bench | 20.00 | — | source ↗ | |
| 03 | Claude Code (Sonnet 4.6) | Anthropic | Collider-Bench | 10.00 | — | source ↗ | |
| 04 | Claude Code (Haiku 4.5) | Anthropic | Collider-Bench | 0.00 | — | source ↗ | |
| 05 | Codex CLI (GPT-5.4-mini) | OpenAI | Collider-Bench | 0.00 | — | source ↗ | |
| 06 | ForgeCode (DeepSeek-V4) | DeepSeek | Collider-Bench | 0.00 | — | source ↗ |
Benchmark trail
Read next
Three places to go from here.
Index
All papers
All tracked papers in the registry, with benchmark result, model, and leaderboard linkage where available.
Replacement
Papers with Code is dead — alternatives
What replaced PWC for each use case: LLMs, OCR, speech, vision, robotics.
Top hub
LLM benchmarks
Every frontier LLM benchmark, scored.