Codesota · Models · CodeT5+Salesforce3 results · 3 benchmarks
Model card

CodeT5+.

Salesforceopen-sourceUnknown paramsT5-based encoder-decoder

Open code LLM family (220M-16B). Strong on code summarization and translation. May 2023.

§ 01 · Benchmarks

Every benchmark CodeT5+ has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Bugs2FixComputer Code · Bug Detectionaccuracy68.2%#4/62023-05-13source ↗
02CodeSearchNetComputer Vision · Optical Character Recognitionbleu-420.0%#5/72023-05-13source ↗
03TransCoder (GeeksForGeeks)Computer Code · Code Translationcomputational-accuracy72.1%#6/72023-05-13source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 02 · Strengths by area

Where CodeT5+ actually performs.

Computer Code
2
benchmarks
avg rank #5.0
Computer Vision
1
benchmark
avg rank #5.0
§ 03 · Papers

1 paper with results for CodeT5+.

  1. 2023-05-13· Computer Code· 3 results

    CodeT5+: Open Code Large Language Models for Code Understanding and Generation

§ 04 · Related models

Other Salesforce models scored on Codesota.

CoAct-1
1 result · 1 SOTA
CodeT5-base
1 result · 1 SOTA
GTA1 (7B)
1 result
BLIP-2
Unknown params · 0 results
CodeT5+ 2B
Unknown params · 0 results
§ 05 · Sources & freshness

Where these numbers come from.

arxiv
3
results
3 of 3 rows marked verified.