Model card
Claude 3.5 Sonnet.
AnthropicproprietaryTransformer (LLM)
Claude 3.5 Sonnet released Jun 2024.
§ 02 · Benchmarks
Every benchmark Claude 3.5 Sonnet has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | WikiTableQuestions | Natural Language Processing · Table Question Answering | accuracy | 73.0% | #2 | — | source ↗ |
| 02 | SWE-bench | Computer Code · Code Generation | resolve-rate-agentic | 27.0% | #21 | 2024-08-01 | |
| 03 | HLE | Reasoning · Multi-step Reasoning | accuracy | 4.1% | #71 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Claude 3.5 Sonnet actually performs.
§ 05 · Related models
Other Anthropic models scored on Codesota.
Claude Opus 4
Undisclosed params · 14 results · 2 SOTA
Claude Sonnet 5
Undisclosed params · 2 results · 2 SOTA
Claude Sonnet 4
11 results · 1 SOTA
Claude Opus 4.5
4 results · 1 SOTA
Claude Opus 4.7
2 results · 1 SOTA
Claude Mythos Preview
1 result · 1 SOTA
Claude 3.5 Sonnet
Undisclosed params · 28 results
Claude Opus 4.5
Undisclosed params · 12 results
§ 06 · Sources & freshness
Where these numbers come from.
arxiv
1
result
openhands
1
result
scale-hle-official
1
result
2 of 3 rows marked verified.