Model card
Codex (davinci-002).
OpenAIapi
§ 02 · Benchmarks
Every benchmark Codex (davinci-002) has a recorded score for.
| # | Benchmark | Area · Task | Metric | Value | Rank | Date | Source |
|---|---|---|---|---|---|---|---|
| 01 | HumanEval | Computer Code · Code Generation | pass@1 | 46.9% | #41 | 2021-07-01 | source ↗ |
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area
Where Codex (davinci-002) actually performs.
§ 04 · Papers
1 paper with results for Codex (davinci-002).
- 2021-07-07· Computer Code· 1 result
Evaluating Large Language Models Trained on Code
§ 05 · Related models
Other OpenAI models scored on Codesota.
§ 06 · Sources & freshness
Where these numbers come from.
shadow-page-humaneval
1
result
1 of 1 rows marked verified.