Recent studyBlind TTS Elo is live. Compare two anonymous voice samples, vote after listening, and help separate real preference signal from noise.Vote in the study ->
Codesota · Tasks · Bug DetectionHome/Tasks/Computer Code/Bug Detection
Computer Code

Bug Detection.

Identifying bugs and vulnerabilities in code.

1
Datasets
6
Results
accuracy
Canonical metric
§ 02 · Canonical benchmark

The reference dataset.

Bugs2Fix

Bug detection and repair benchmark with ~2.4M Java methods mined from GitHub commits labeled as bug fixes. Used widely to evaluate LLM bug detection capabilities. Primary metric is Accuracy (correct bug classification).

Primary metric: accuracy
View full leaderboard →
§ 03 · Top 10

Leading models.

Leading models on Bugs2Fix.

#ModelaccuracyYearSource
★GPT-4o✓78.62026paper ↗
2Qwen2.5-Coder 32B✓76.82026paper ↗
3DeepSeek-Coder-V2-Instruct✓75.32026paper ↗
4CodeT5+✓68.22026paper ↗
5UniXcoder✓66.42026paper ↗
6CodeBERT✓62.52026paper ↗

What were you looking for on Bug Detection?

Didn't find the model, metric, or dataset you needed? Tell us in one line. We read every message and reply within 48 hours.

§ 04 · All datasets

Tracked datasets.

1 dataset tracked for this task.

Bugs2Fix
CANONICAL
6 results · accuracy
Top: GPT-4o — 78.6
§ 05 · Related tasks

Other tasks in Computer Code.

Code CompletionCode GenerationCode SummarizationCode TranslationProgram Repair
Reply within 48 hours · No newsletter

Didn't find what you came for?

Still looking for something on Bug Detection? A missing model, a stale score, a benchmark we should cover — drop it here and we'll handle it.

Real humans read every message. We track what people are asking for and prioritize accordingly.