Codesota · Models · DevinCognition1 results · 1 benchmarks
Model card

Devin.

Cognitionapi
§ 01 · Benchmarks

Every benchmark Devin has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01SWE-BenchComputer Code · Code Generationresolve-rate-agentic13.8%#23/252024-05-01unverified
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where Devin actually performs.

Computer Code
1
benchmark
avg rank #23.0
§ 05 · Sources & freshness

Where these numbers come from.

cognition-devin
1
result
0 of 1 rows marked verified.