Codesota · Models · Claude 3.5 Sonnet v2Anthropic1 results · 1 benchmarks
Model card

Claude 3.5 Sonnet v2.

AnthropicapiUndisclosed params
§ 01 · Benchmarks

Every benchmark Claude 3.5 Sonnet v2 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01SWE-BenchComputer Code · Code Generationresolve-rate49.0%#24/322024-12-01source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Claude 3.5 Sonnet v2 actually performs.

Computer Code
1
benchmark
avg rank #24.0
§ 03 · Papers

1 paper with results for Claude 3.5 Sonnet v2.

  1. 2023-10-10· Computer Code· 1 result

    SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

    Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao et al.
§ 04 · Related models

Other Anthropic models scored on Codesota.

Claude Opus 4
Undisclosed params · 13 results · 2 SOTA
Claude Opus 4.5
3 results · 2 SOTA
Claude Sonnet 5
Undisclosed params · 2 results · 2 SOTA
Claude Sonnet 4
10 results · 1 SOTA
Claude Mythos Preview
1 result · 1 SOTA
Claude 3.5 Sonnet
Undisclosed params · 27 results
Claude Opus 4.5
Undisclosed params · 13 results
Claude 3.7 Sonnet
10 results
§ 05 · Sources & freshness

Where these numbers come from.

sota-timeline
1
result
1 of 1 rows marked verified.