Codesota · Models · O1-2024-12-17OpenAI7 results · 1 benchmarks
Model card

O1-2024-12-17.

OpenAIopen-source
§ 02 · Benchmarks

Every benchmark O1-2024-12-17 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment86.0%#10/165source ↗
02PLCCNatural Language Processing · Polish Cultural Competencyvocabulary88.0%#10/165source ↗
03PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition92.0%#10/165source ↗
04PLCCNatural Language Processing · Polish Cultural Competencygeography95.0%#12/165source ↗
05PLCCNatural Language Processing · Polish Cultural Competencyaverage89.2%#12/165source ↗
06PLCCNatural Language Processing · Polish Cultural Competencygrammar84.0%#13/165source ↗
07PLCCNatural Language Processing · Polish Cultural Competencyhistory90.0%#16/165source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where O1-2024-12-17 actually performs.

Natural Language Processing
1
benchmark
avg rank #11.9
§ 05 · Related models

Other OpenAI models scored on Codesota.

GPT-4o
Undisclosed params · 38 results · 9 SOTA
o3
17 results · 5 SOTA
o4-mini
14 results · 2 SOTA
o3 (high)
2 results · 1 SOTA
Codex / GPT-5.5
1 result · 1 SOTA
Codex CLI (GPT-5.5)
1 result · 1 SOTA
o4-mini (high)
1 result · 1 SOTA
o1
12 results
§ 06 · Sources & freshness

Where these numbers come from.

sdadas/PLCC
7
results
7 of 7 rows marked verified.