Codesota · Models · LLaMA-65B9 results · 9 benchmarks
Model card
LLaMA-65B.
unknown1 current SOTA
§ 02 · Benchmarks
Every benchmark LLaMA-65B has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | Natural Questions | Natural Language Processing · Question Answering | accuracy | 39.9% | #1 | — | source ↗ |
| 02 | TriviaQA | Natural Language Processing · Question Answering | accuracy | 73.0% | #2 | — | source ↗ |
| 03 | WinoGrande | Reasoning · Commonsense Reasoning | accuracy | 77.0% | #7 | — | source ↗ |
| 04 | HellaSwag | Reasoning · Commonsense Reasoning | accuracy | 84.2% | #8 | — | source ↗ |
| 05 | MBPP+ | Computer Code · Code Generation | pass-1 | 37.7% | #9 | — | source ↗ |
| 06 | HumanEval+ | Computer Code · Code Generation | pass-1 | 23.7% | #10 | — | source ↗ |
| 07 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 69.7% | #41 | — | source ↗ |
| 08 | MATH | Reasoning · Mathematical Reasoning | accuracy | 20.5% | #45 | — | source ↗ |
| 09 | MMLU | Reasoning · Commonsense Reasoning | accuracy | 63.4% | #58 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where LLaMA-65B actually performs.
§ 04 · Papers
1 paper with results for LLaMA-65B.
- 2023-02-27· 9 results
LLaMA: Open and Efficient Foundation Language Models
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
9
results
0 of 9 rows marked verified.