Codesota · Models · BitNet b1.58 2B4T6 results · 6 benchmarks
Model card
BitNet b1.58 2B4T.
unknown
§ 02 · Benchmarks
Every benchmark BitNet b1.58 2B4T has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | CommonsenseQA | Reasoning · Commonsense Reasoning | accuracy | 71.6% | #4 | — | source ↗ |
| 02 | TriviaQA | Natural Language Processing · Question Answering | accuracy | 33.6% | #4 | — | source ↗ |
| 03 | WinoGrande | Reasoning · Commonsense Reasoning | accuracy | 71.9% | #10 | — | source ↗ |
| 04 | HellaSwag | Reasoning · Commonsense Reasoning | accuracy | 68.4% | #14 | — | source ↗ |
| 05 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 58.4% | #43 | — | source ↗ |
| 06 | MMLU | Reasoning · Commonsense Reasoning | accuracy | 53.2% | #63 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where BitNet b1.58 2B4T actually performs.
§ 04 · Papers
1 paper with results for BitNet b1.58 2B4T.
- 2025-04-16· 6 results
BitNet b1.58 2B4T Technical Report
§ 06 · Sources & freshness
Where these numbers come from.
pwc-dump
6
results
0 of 6 rows marked verified.