Model card
GPT-4.
OpenAIproprietaryTransformer (LLM)3 current SOTA
GPT-4 Technical Report. OpenAI, Mar 2023.
§ 02 · Benchmarks
Every benchmark GPT-4 has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | WMT'23 | Natural Language Processing · Machine Translation | comet | 84.1% | #1 | — | source ↗ |
| 02 | WikiTableQuestions | Natural Language Processing · Table Question Answering | accuracy | 75.3% | #1 | — | source ↗ |
| 03 | XNLI | Natural Language Processing · Zero-Shot Classification | accuracy | 87.4% | #1 | — | source ↗ |
| 04 | SWE-bench | Computer Code · Code Generation | resolve-rate-agentic | 12.5% | #24 | 2024-03-01 | |
| 05 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 92.0% | #31 | 2023-03-01 | source ↗ |
| 06 | GSM8K | Reasoning · Mathematical Reasoning | accuracy | 92.0% | #31 | 2023-03-01 | source ↗ |
| 07 | PLCC | Natural Language Processing · Polish Cultural Competency | culture-and-tradition | 63.0% | #81 | — | source ↗ |
| 08 | PLCC | Natural Language Processing · Polish Cultural Competency | grammar | 58.0% | #86 | — | source ↗ |
| 09 | PLCC | Natural Language Processing · Polish Cultural Competency | history | 72.0% | #90 | — | source ↗ |
| 10 | PLCC | Natural Language Processing · Polish Cultural Competency | average | 59.5% | #91 | — | source ↗ |
| 11 | PLCC | Natural Language Processing · Polish Cultural Competency | art-and-entertainment | 49.0% | #91 | — | source ↗ |
| 12 | PLCC | Natural Language Processing · Polish Cultural Competency | vocabulary | 48.0% | #95 | — | source ↗ |
| 13 | PLCC | Natural Language Processing · Polish Cultural Competency | geography | 67.0% | #99 | — | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where GPT-4 actually performs.
§ 05 · Related models
Other OpenAI models scored on Codesota.
§ 06 · Sources & freshness
Where these numbers come from.
sdadas/PLCC
7
results
arxiv
3
results
swe-agent
1
result
gsm8k-shadow-page
1
result
gsm8k-shadow-page-timeline
1
result
10 of 13 rows marked verified. · first result 2023-03-01, latest 2024-03-01.