Model card
CodeBERT.
Microsoftopen-sourceUnknown paramsBERT
Pre-trained model for programming and natural languages. 125M parameters.
§ 02 · Benchmarks
Every benchmark CodeBERT has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Bugs2Fix | Computer Code · Bug Detection | accuracy | 62.5% | #6 | 2020-02-19 | source ↗ |
| 02 | CodeSearchNet | Computer Vision · Optical Character Recognition | bleu-4 | 17.6% | #7 | 2020-02-19 | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where CodeBERT actually performs.
§ 04 · Papers
1 paper with results for CodeBERT.
- 2020-02-19· Computer Code· 2 results
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
§ 05 · Related models
Other Microsoft models scored on Codesota.
RAD-DINO
2 results · 1 SOTA
NaturalSpeech 3
~500M params · 1 result · 1 SOTA
Swin Transformer V2 Large
197M params · 1 result · 1 SOTA
WavLM Large (SV)
316M params · 1 result · 1 SOTA
ResNet-152
60M params · 3 results
ResNet-50
25M params · 3 results
DeBERTa-v3-large
304M params · 2 results
Florence-2-Large
2 results
§ 06 · Sources & freshness
Where these numbers come from.
arxiv
2
results
2 of 2 rows marked verified.