Codesota · Benchmark · AudioBenchHome/Leaderboards/Multimodal Media/Audio + Text to Text/AudioBench
Unknown

AudioBench.

Comprehensive evaluation of audio understanding language models

Paper Leaderboard
§ 01 · Leaderboard

Results by metric.

Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result Report issue

Avg Score

Avg Score is the reported evaluation metric for AudioBench. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for Avg Scoreverifiedpapervendorcommunityunverified

Muted rows were not state of the art when published — an earlier or same-year result already scored better.

RankModelTrustScoreYearLinksFix
01WavLLM
Average of 19 non-ASR higher-is-better subtasks from AudioBench Table 2 (arXiv:2406.16020v5). WavLLM. Note: paper evaluates 5 models; GPT-4o/Gemini not included in original evaluation.
verified50.252026Source ↗Looks wrong?
02SALMONN
Average of 19 non-ASR higher-is-better subtasks from AudioBench Table 2 (arXiv:2406.16020v5). SALMONN. Note: paper evaluates 5 models; GPT-4o/Gemini not included in original evaluation.
verified43.992026Source ↗Looks wrong?
03Qwen2-Audio-Instruct
Average of 19 non-ASR higher-is-better subtasks from AudioBench Table 2 (arXiv:2406.16020v5). Qwen2-Audio-Instruct. Note: paper evaluates 5 models; GPT-4o/Gemini not included in original evaluation.
verified42.122026Source ↗Looks wrong?
04Whisper+LLaMA-3 (cascade)
Average of 19 non-ASR higher-is-better subtasks from AudioBench Table 2 (arXiv:2406.16020v5). Whisper+LLaMA-3 (cascade). Note: paper evaluates 5 models; GPT-4o/Gemini not included in original evaluation.
verified40.92026Source ↗Looks wrong?
05Qwen-Audio-Chat
Average of 19 non-ASR higher-is-better subtasks from AudioBench Table 2 (arXiv:2406.16020v5). Qwen-Audio-Chat. Note: paper evaluates 5 models; GPT-4o/Gemini not included in original evaluation.
verified38.592026Source ↗Looks wrong?
§ 04 · Submit a result

Add to the leaderboard.

← Back to Audio + Text to Text