Codesota · Models · Code Llama - Python 70B (3-shot)1 results · 1 benchmarks
Model card
Code Llama - Python 70B (3-shot).
unknown
§ 02 · Benchmarks
Every benchmark Code Llama - Python 70B (3-shot) has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | MBPP+ | Computer Code · Code Generation | pass-1 | 65.6% | #6 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Code Llama - Python 70B (3-shot) actually performs.
§ 04 · Papers
1 paper with results for Code Llama - Python 70B (3-shot).
- 2023-08-24· 1 result
Code Llama: Open Foundation Models for Code
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
1
result
0 of 1 rows marked verified.