Codesota · Models · Claude 3.5 SonnetAnthropic2 results · 2 benchmarks
Model card

Claude 3.5 Sonnet.

AnthropicproprietaryTransformer (LLM)

Claude 3.5 Sonnet released Jun 2024.

§ 01 · Benchmarks

Every benchmark Claude 3.5 Sonnet has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01WikiTableQuestionsNatural Language Processing · Table Question Answeringaccuracy73.0%#2/3source ↗
02SWE-BenchComputer Code · Code Generationresolve-rate-agentic27.0%#21/252024-08-01unverified
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Claude 3.5 Sonnet actually performs.

Natural Language Processing
1
benchmark
avg rank #2.0
Computer Code
1
benchmark
avg rank #21.0
§ 04 · Related models

Other Anthropic models scored on Codesota.

Claude Opus 4
Undisclosed params · 13 results · 2 SOTA
Claude Opus 4.5
3 results · 2 SOTA
Claude Sonnet 5
Undisclosed params · 2 results · 2 SOTA
Claude Sonnet 4
10 results · 1 SOTA
Claude Mythos Preview
1 result · 1 SOTA
Claude 3.5 Sonnet
Undisclosed params · 27 results
Claude Opus 4.5
Undisclosed params · 13 results
Claude 3.7 Sonnet
10 results
§ 05 · Sources & freshness

Where these numbers come from.

arxiv
1
result
openhands
1
result
1 of 2 rows marked verified.