Codesota · OCR · Benchmarks · mbppHome/OCR/Benchmarks/mbpp
Unknown

mbpp.

OCR benchmark

§ 01 · pass@1

pass@1.

Higher is better

#ModelScoreSource
★
Claude 3.5 Sonnet (Oct 2024)
Fetched from CodeSOTA API on 2026-04-20
91codesota-api
2
Qwen2.5-Coder-32B-Instruct
Fetched from CodeSOTA API on 2026-04-20
90.2codesota-api
3
DeepSeek-Coder-V2-Instruct
Fetched from CodeSOTA API on 2026-04-20
89.4codesota-api
4
claude-35-sonnet
Fetched from CodeSOTA API on 2026-04-20
89.2codesota-api
5
gpt-4o
Fetched from CodeSOTA API on 2026-04-20
87.8codesota-api
6
GPT-4o (Aug 2024)
Fetched from CodeSOTA API on 2026-04-20
86.8codesota-api
7
Qwen2.5-Coder-7B-Instruct
Fetched from CodeSOTA API on 2026-04-20
83.5codesota-api
8
Codestral 22B v0.1
Fetched from CodeSOTA API on 2026-04-20
78.2codesota-api
9
Llama 4 Maverick (17B-128E)
Fetched from CodeSOTA API on 2026-04-20
77.6codesota-api
10
DeepSeek-V3
Fetched from CodeSOTA API on 2026-04-20
75.4codesota-api
11
Gemma 3 27B IT
Fetched from CodeSOTA API on 2026-04-20
74.4codesota-api
12
Gemma 3 12B IT
Fetched from CodeSOTA API on 2026-04-20
73codesota-api
13
Llama 4 Scout (17B-16E)
Fetched from CodeSOTA API on 2026-04-20
67.8codesota-api
14
Gemma 3 4B IT
Fetched from CodeSOTA API on 2026-04-20
63.2codesota-api
§ Related · Explore

More OCR content.

Verified Model Reviews
Comparisons & Guides
View all OCR benchmarks →← Back to All Benchmarks