Model card
pre-train w/ code only.
UnknownunknownUnknown paramsUnknown
Imported from Papers With Code
§ 02 · Benchmarks
Every benchmark pre-train w/ code only has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | CodeSearchNet | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 15.2% | #3 | 2020-02-19 | source ↗ |
| 02 | codesearchnet---go | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 26.4% | #3 | 2020-02-19 | source ↗ |
| 03 | codesearchnet---php | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 20.7% | #4 | 2020-02-19 | source ↗ |
| 04 | codesearchnet---python | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 15.1% | #4 | 2020-02-19 | source ↗ |
| 05 | codesearchnet---ruby | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 7.4% | #5 | 2020-02-19 | source ↗ |
| 06 | codesearchnet---java | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 13.1% | #11 | 2020-02-19 | source ↗ |
| 07 | codesearchnet---javascript | Computer Vision · Optical Character Recognition | smoothed-bleu-4 | 8.3% | #12 | 2020-02-19 | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where pre-train w/ code only actually performs.
§ 04 · Papers
1 paper with results for pre-train w/ code only.
- 2020-02-19· Computer Vision· 7 results
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
§ 05 · Related models
Other Unknown models scored on Codesota.
CRAFT
Unknown params · 21 results
GPT-2-Large (fine-tuning)
Unknown params · 20 results
HTLM (fine-tuning)
Unknown params · 20 results
TextFuseNet (ResNeXt-101)
Unknown params · 16 results
MixNet
Unknown params · 13 results
PAN
Unknown params · 12 results
SPCNET
Unknown params · 12 results
TESTR
Unknown params · 12 results
§ 06 · Sources & freshness
Where these numbers come from.
papers-with-code
7
results
7 of 7 rows marked verified.