Codesota · Models · GPT-4o-mini-2024-07-18OpenAI8 results · 2 benchmarks
Model card

GPT-4o-mini-2024-07-18.

OpenAIopen-source
§ 02 · Benchmarks

Every benchmark GPT-4o-mini-2024-07-18 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score71.2%#15/101source ↗
02PLCCNatural Language Processing · Polish Cultural Competencyvocabulary51.0%#93/165source ↗
03PLCCNatural Language Processing · Polish Cultural Competencygeography69.0%#93/165source ↗
04PLCCNatural Language Processing · Polish Cultural Competencyculture-and-tradition57.0%#94/165source ↗
05PLCCNatural Language Processing · Polish Cultural Competencygrammar55.0%#97/165source ↗
06PLCCNatural Language Processing · Polish Cultural Competencyaverage56.8%#99/165source ↗
07PLCCNatural Language Processing · Polish Cultural Competencyhistory67.0%#103/165source ↗
08PLCCNatural Language Processing · Polish Cultural Competencyart-and-entertainment42.0%#113/165source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where GPT-4o-mini-2024-07-18 actually performs.

Natural Language Processing
2
benchmarks
avg rank #88.4
§ 05 · Related models

Other OpenAI models scored on Codesota.

GPT-4o
Undisclosed params · 57 results
o3
19 results
GPT-3.5-turbo
17 results
o4-mini
16 results
Whisper Large v2
1.5B params · 14 results
GPT-4
13 results
GPT-4 Turbo
Undisclosed params · 13 results
o1
12 results
§ 06 · Sources & freshness

Where these numbers come from.

sdadas/PLCC
7
results
SpeakLeash/Polish-EQ-Bench
1
result
8 of 8 rows marked verified.