Model card
Qwen2.5-Coder 32B.
Alibabaopen-source32B paramsDense Transformer
32B parameters. SOTA open-source code model at release (Nov 2024). Matches GPT-4o on HumanEval.
§ 01 · Benchmarks
Every benchmark Qwen2.5-Coder 32B has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Bugs2Fix | Computer Code · Bug Detection | accuracy | 76.8% | #2 | 2024-09-19 | source ↗ |
| 02 | CodeSearchNet | Computer Vision · Optical Character Recognition | bleu-4 | 23.4% | #2 | 2024-09-19 | source ↗ |
| 03 | CrossCodeEval | Computer Code · Code Completion | exact-match | 43.7% | #2 | 2024-09-19 | source ↗ |
| 04 | TransCoder (GeeksForGeeks) | Computer Code · Code Translation | computational-accuracy | 86.3% | #3 | 2024-09-19 | source ↗ |
| 05 | MBPP | Computer Code · Code Generation | pass@1 | 90.2% | #5 | 2024-09-19 | source ↗ |
| 06 | HumanEval | Computer Code · Code Generation | pass@1 | 92.7% | #9 | 2025-03-01 | source ↗ |
| 07 | HumanEval | Computer Code · Code Generation | pass@1 | 92.7% | #9 | 2024-09-19 | source ↗ |
| 08 | SWE-Bench | Computer Code · Code Generation | resolve-rate | 55.4% | #22 | 2025-06-01 | source ↗ |
| 09 | LiveCodeBench | Computer Code · Code Generation | pass@1 | 47.8% | #22 | 2024-03-12 | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area
Where Qwen2.5-Coder 32B actually performs.
§ 03 · Papers
3 papers with results for Qwen2.5-Coder 32B.
- 2024-09-19· Computer Code· 6 results
Qwen2.5-Coder Technical Report
- 2024-03-12· Computer Code· 1 result
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- 2023-10-10· Computer Code· 1 result
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao et al.
§ 04 · Related models
Other Alibaba models scored on Codesota.
§ 05 · Sources & freshness
Where these numbers come from.
arxiv
6
results
shadow-page-humaneval
1
result
swebench-leaderboard
1
result
official-leaderboard
1
result
9 of 9 rows marked verified. · first result 2024-03-12, latest 2025-06-01.