Codesota · Benchmark · codesearchnet---javaHome/Leaderboards/Vision & Documents/Document OCR/codesearchnet---java
Unknown

codesearchnet---java.

codesearchnet---java is a state-of-the-art machine learning benchmark indexed on Codesota. This page tracks published model results, top scores per metric, and the SOTA timeline for codesearchnet---java.

Paper ↗Leaderboard ↓
§ 01 · SOTA history

Year over year.

§ 02 · Leaderboard

Results by metric.

Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result ↗Report issue ↗

Smoothed Bleu 4

Smoothed Bleu 4 is the reported evaluation metric for codesearchnet---java. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for Smoothed Bleu 4verifiedpapervendorcommunityunverified
RankModelTrustScoreYearLinksFix
01StarCoder-LoRA
StarCoder fine-tuned with LoRA. Anonymous submission on CodeXGLUE code summarization Java leaderboard. New SOTA surpassing CodeTrans-MT-Large (21.87).
unverified22.612024Source ↗Looks wrong?
02CodeTrans-MT-Large
From paper: CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing
verified21.872021Paper ↗Code ↗Looks wrong?
03DistillCodeT5
DistillCodeT5 by FSOFT AI Lab. Knowledge-distilled CodeT5. CodeXGLUE Java code summarization leaderboard.
unverified20.512024Source ↗Looks wrong?
04PolyglotCodeBERT
From paper: Multilingual training for Software Engineering (arXiv 2112.02043). Smoothed BLEU-4 on CodeXGLUE Java test set.
verified20.112021Source ↗Looks wrong?
05ProphetNet-X
From paper: ProphetNet-X (arXiv 2104.08006). ProphetNet-Code variant. Smoothed BLEU-4 on CodeXGLUE Java test set.
verified19.392021Source ↗Looks wrong?
06CoTexT
From paper: CoTexT: Multi-task Learning with Code-Text Transformer (arXiv 2105.08645). Smoothed BLEU-4 on CodeXGLUE Java test set.
verified19.062021Source ↗Looks wrong?
07PLBART
From paper: Unified Pre-training for Program Understanding and Generation / PLBART (arXiv 2103.06333). NAACL 2021. Smoothed BLEU-4 on CodeXGLUE Java test set.
verified18.452021Source ↗Looks wrong?
08CodeBERT (MLM+RTD)
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified14.562020Paper ↗Code ↗Looks wrong?
09CodeBERT (MLM)
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified13.592020Paper ↗Code ↗Looks wrong?
10RoBERTa
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified13.22020Paper ↗Code ↗Looks wrong?
11pre-train w/ code only
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified13.072020Paper ↗Code ↗Looks wrong?
12CodeBERT (RTD)
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified12.722020Paper ↗Code ↗Looks wrong?
13Transformer
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified12.572020Paper ↗Code ↗Looks wrong?
14seq2seq
From paper: CodeBERT: A Pre-Trained Model for Programming and Natural Languages
verified11.422020Paper ↗Code ↗Looks wrong?
§ 04 · Submit a result

Add to the leaderboard.

← Back to Document OCR