Codesota · Models · O1-2024-12-17OpenAI7 results · 1 benchmarks
Model card

O1-2024-12-17.

OpenAIopen-source
§ 02 · Benchmarks

Every benchmark O1-2024-12-17 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment86.0%#10/165source ↗
02PLCCNatural Language Processing · Polish Cultural Competencyvocabulary88.0%#10/165source ↗
03PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition92.0%#10/165source ↗
04PLCCNatural Language Processing · Polish Cultural Competencygeography95.0%#12/165source ↗
05PLCCNatural Language Processing · Polish Cultural Competencyaverage89.2%#12/165source ↗
06PLCCNatural Language Processing · Polish Cultural Competencygrammar84.0%#13/165source ↗
07PLCCNatural Language Processing · Polish Cultural Competencyhistory90.0%#16/165source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where O1-2024-12-17 actually performs.

Natural Language Processing
1
benchmark
avg rank #11.9
§ 05 · Related models

Other OpenAI models scored on Codesota.

GPT-4o
Undisclosed params · 57 results
o3
19 results
GPT-3.5-turbo
17 results
o4-mini
16 results
Whisper Large v2
1.5B params · 14 results
GPT-4
13 results
GPT-4 Turbo
Undisclosed params · 13 results
o1
12 results
§ 06 · Sources & freshness

Where these numbers come from.

sdadas/PLCC
7
results
7 of 7 rows marked verified.