Code Summarization2021en

CodeXGLUE Code-to-Text Python subset

Python subset of CodeXGLUE Code-to-Text: generate natural-language docstrings/comments from Python function bodies. Derived from CodeSearchNet. Evaluated with smoothed BLEU-4.

Paper / Website
Current State of the Art

CodeT5-base

Salesforce

20.01

bleu

CodeXGLUE Code-to-Text (Python) — bleu

3 results · 1 SOTA advances · higher is better

All results
SOTA frontier
1819202120262027bleuCodeT5-base

bleu Progress Over Time

Showing 2 breakthroughs from Mar 2021 to Sep 2021

19.219.419.719.920.1Mar 2021Sep 2021bleuDate

Key Milestones

Mar 2021
PLBART

PLBART on CodeXGLUE Code-to-Text Python, smoothed BLEU-4. seed — verify

19.3
Source
Sep 2021
CodeT5-baseCurrent SOTA

CodeT5-base Python subset smoothed BLEU-4. seed — verify

20.0
+3.7%
Source
Total Improvement
3.7%
Time Span
6m
Breakthroughs
2
Current SOTA
20.0

Top Models Performance Comparison

Top 3 models ranked by bleu

bleu1CodeT5-base20.0100.0%2PLBART19.396.5%3CodeBERT19.195.3%0%25%50%75%100%% of best
Best Score
20.0
Top Model
CodeT5-base
Models Compared
3
Score Range
0.950

bleuPrimary

#ModelScorePaper / CodeDate
1
CodeT5-baseOpen Source
Salesforce		20.01
editorial
Apr 2026
2
PLBARTOpen Source
UCLA / Columbia		19.3
editorial
Apr 2026
3
CodeBERTOpen Source
Microsoft		19.06
editorial
Apr 2026