How many models are tracked on codesearchnet---go?

Codesota tracks 7 models on codesearchnet---go.

When was the codesearchnet---go leaderboard last updated?

The codesearchnet---go leaderboard on Codesota includes results through 2021, with the earliest tracked result from 2020.

Codesota · Computer Vision · Optical Character Recognition · codesearchnet---goTasks/Computer Vision/Optical Character Recognition

Optical Character Recognition · benchmark dataset · 2020 · EN

codesearchnet---go.

Name: codesearchnet---go Benchmark Results
Creator: Codesota
Published: 2020-01-01
License: https://creativecommons.org/licenses/by/4.0/

Dataset from Papers With Code

Submit a result ↵

§ 01 · Leaderboard

Best published scores.

7 results indexed across 1 metric. Shaded row marks current SOTA; ties broken by submission date.

Primary: accuracy · higher is better

smoothed-bleu-4

7 rows

#	Model	Org	Submitted	Paper / code	smoothed-bleu-4
01	CodeBERT (MLM)	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	26.79
02	CodeBERT (MLM+RTD)	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	26.66
03	pre-train w/ code only	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	26.39
04	RoBERTa	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	26.09
05	CodeBERT (RTD)	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	26.02
06	seq2seq	—	Feb 2020	CodeBERT: A Pre-Trained Model for Programming and Natura… · code	23.48
07	CodeTrans-TF-Large	—	Apr 2021	CodeTrans: Towards Cracking the Language of Silicon's Co… · code	19.54

Fig 2 · Rows sorted by score within each metric. Shaded row marks SOTA. Dates reflect model or paper release where available, otherwise the date Codesota accessed the source.

§ 04 · Literature

2 papers
tied to this benchmark.

Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.

CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing
Apr 2021·CodeTrans-TF-Large
arXiv ↗Code
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feb 2020·CodeBERT (MLM), CodeBERT (MLM+RTD), pre-train w/ code only +3
arXiv ↗Code

§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result ↵Read submission guide

What a submission needs

01A public checkpoint or API endpoint
02A reproduction script with frozen commit + seed
03Declared evaluation environment (Python, deps)
04One row per metric declared by this dataset
05A contact so we can follow up on discrepancies

codesearchnet---go.

Best published scores.

2 paperstied to this benchmark.

Neighbouring benchmarks.

Have a score that beatsthis table?

2 papers
tied to this benchmark.

Have a score that beats
this table?