Codesota · Models · SmoLM2 (1.7B)10 results · 10 benchmarks
Model card
SmoLM2 (1.7B).
unknown
§ 02 · Benchmarks
Every benchmark SmoLM2 (1.7B) has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | HumanEval | Computer Code · Code Generation | pass-1 | 22.6% | #3 | — | source ↗ |
| 02 | TriviaQA | Natural Language Processing · Question Answering | accuracy | 36.7% | #3 | — | source ↗ |
| 03 | CommonsenseQA | Reasoning · Commonsense Reasoning | accuracy | 43.6% | #5 | — | source ↗ |
| 04 | Natural Questions | Natural Language Processing · Question Answering | accuracy | 8.7% | #5 | — | source ↗ |
| 05 | BIG-Bench Hard | Reasoning · Multi-step Reasoning | accuracy | 32.2% | #11 | — | source ↗ |
| 06 | HumanEval+ | Computer Code · Code Generation | pass-1 | 22.6% | #11 | — | source ↗ |
| 07 | WinoGrande | Reasoning · Commonsense Reasoning | accuracy | 59.4% | #12 | — | source ↗ |
| 08 | HellaSwag | Reasoning · Commonsense Reasoning | accuracy | 68.7% | #13 | — | source ↗ |
| 09 | MATH | Reasoning · Mathematical Reasoning | accuracy | 11.6% | #46 | — | source ↗ |
| 10 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 31.1% | #47 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where SmoLM2 (1.7B) actually performs.
§ 04 · Papers
1 paper with results for SmoLM2 (1.7B).
- 2025-02-04· 10 results
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
10
results
0 of 10 rows marked verified.