HuggingFace ↔ CodeSOTA

Every HuggingFace pipeline task mapped to CodeSOTA benchmarks. Find which benchmarks evaluate models for any HF task.

52HF tasks
52Mapped
52With benchmarks
94CodeSOTA-only

Multimodal

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
any-to-any
Any-to-Any
Multimodal
1
0
audio-text-to-text
Audio-Text-to-Text
Multimodal
3
0
document-question-answering
Document Understanding
Computer Vision
3
7
image-text-to-text
Image-Text-to-Text
Multimodal
3
0
image-text-to-image
Image-Text-to-Image
Multimodal
2
0
image-text-to-video
Image-Text-to-Video
Multimodal
1
0
image-to-text
Image Captioning
Multimodal
2
2
text-to-image
Text-to-Image Generation
Multimodal
3
0
video-text-to-text
Video Understanding
Multimodal
2
0
visual-document-retrieval
Cross-Modal Retrieval
Multimodal
1
0
visual-question-answering
Visual Question Answering
Multimodal
8
47

Computer Vision

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
depth-estimation
Depth estimation
Computer Vision
17
0
image-classification
Image Classification
Computer Vision
28
44
image-feature-extraction
Image Feature Extraction
Computer Vision
1
0
image-segmentation
Semantic Segmentation
Computer Vision
2
6
image-to-image
Image-to-Image
Computer Vision
2
0
image-to-video
Image-to-Video
Computer Vision
1
0
image-to-3d
Image-to-3D
Computer Vision
1
0
keypoint-detection
Keypoint Detection
Computer Vision
2
0
mask-generation
Mask Generation
Computer Vision
1
0
object-detection
Object Detection
Computer Vision
11
46
text-to-3d
Text-to-3D
Computer Vision
1
0
text-to-video
Text-to-Video
Computer Vision
2
0
unconditional-image-generation
Unconditional Image Generation
Computer Vision
2
0
video-classification
Video classification
Computer Vision
9
0
video-to-video
Video-to-Video
Computer Vision
1
0
zero-shot-image-classification
Zero-Shot Image Classification
Computer Vision
1
0
zero-shot-object-detection
Zero-Shot Object Detection
Computer Vision
2
0

Natural Language Processing

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
feature-extraction
Feature Extraction
Natural Language Processing
1
6
fill-mask
Fill-Mask
Natural Language Processing
1
3
question-answering
Question Answering
Natural Language Processing
10
26
sentence-similarity
Semantic Textual Similarity
Natural Language Processing
1
3
summarization
Text Summarization
Natural Language Processing
1
15
table-question-answering
Table Question Answering
Natural Language Processing
2
3
text-classification
Text classification
Natural Language Processing
3
12
text-generation
Language Modeling
Natural Language Processing
55
14
text-ranking
Text Ranking
Natural Language Processing
2
8
token-classification
Named Entity Recognition
Natural Language Processing
1
7
translation
Machine Translation
Natural Language Processing
8
5
zero-shot-classification
Zero-Shot Classification
Natural Language Processing
1
3

Audio

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
audio-classification
Audio Classification
Audio
6
0
audio-to-audio
Audio-to-Audio
Audio
2
0
automatic-speech-recognition
Speech Recognition
Speech
4
20
text-to-audio
Text-to-Audio
Audio
1
0
text-to-speech
Text-to-speech
Audio
2
11
voice-activity-detection
Voice Activity Detection
Audio
2
0

Tabular

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
tabular-classification
Tabular Classification
Time Series
1
5
tabular-regression
Tabular Regression
Time Series
1
2
time-series-forecasting
Time-series forecasting
Time-series
6
75

Reinforcement Learning

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
reinforcement-learning
Atari Games
Reinforcement Learning
1
12
robotics
Robotics
Other
5
0

Other

HF Pipeline Tag
CodeSOTA Task
Area
Benchmarks
Results
graph-ml
Node Classification
Graphs
2
6

CodeSOTA-only tasks

Tasks tracked by CodeSOTA that don't have a direct HuggingFace pipeline equivalent.

Adversarial

Adversarial Attacks1 benchmarks
Adversarial Robustness1 benchmarks

Agentic AI

Agent Memory2 benchmarks
Autonomous Coding2 benchmarks23 results
Bioinformatics Agents1 benchmarks2 results
HCAST1 benchmarks6 results
RE-Bench1 benchmarks5 results
SWE-bench1 benchmarks81 results
Task agents7 benchmarks35 results
Time Horizon1 benchmarks5 results
Tool Use1 benchmarks8 results
Web & Desktop Agents2 benchmarks19 results

Audio

Audio Captioning1 benchmarks3 results
Audio-Language Models18 benchmarks
Automatic Speech Recognition25 benchmarks
Music Generation1 benchmarks3 results
Sound Event Detection1 benchmarks3 results
Voice cloning1 benchmarks3 results

Computer Code

Bug Detection1 benchmarks6 results
Code Completion1 benchmarks6 results
Code Generation10 benchmarks196 results
Code Summarization1 benchmarks3 results
Code Translation1 benchmarks7 results
Program Repair1 benchmarks5 results

Computer Vision

3D Understanding4 benchmarks
3D generation0
Document Image Classification7 benchmarks62 results
Document Layout Analysis5 benchmarks133 results
Document Parsing3 benchmarks117 results
Few-Shot Image Classification97 benchmarks
General OCR Capabilities4 benchmarks66 results
Handwriting Recognition6 benchmarks40 results
Image editing5 benchmarks
Image generation11 benchmarks
Image segmentation9 benchmarks3 results
OCR5 benchmarks1 results
Object counting1 benchmarks
Open-Vocabulary Object Detection2 benchmarks
Optical Character Recognition114 benchmarks829 results
Scene Text Detection11 benchmarks581 results
Scene Text Recognition11 benchmarks127 results
Table Recognition5 benchmarks71 results
Video generation0
Video segmentation3 benchmarks

General

Coding Agents7 benchmarks4 results
Computer Use Agents11 benchmarks
Embedding models0
General1 benchmarks
Omni models2 benchmarks
Reasoning0
Reinforcement Learning0
Retrieval7 benchmarks
Video-Language Models19 benchmarks4 results
Vision-Language Models40 benchmarks
World Models0

Graphs

Link Prediction1 benchmarks3 results
Molecular Property Prediction1 benchmarks3 results

Industrial Inspection

Anomaly Detection7 benchmarks27 results
Steel Defect Detection1 benchmarks
Surface Defect Detection1 benchmarks
Weld Inspection1 benchmarks

Knowledge Base

Entity Linking1 benchmarks3 results
Knowledge Graph Completion1 benchmarks3 results
Relation Extraction1 benchmarks3 results

Medical

Clinical NLP1 benchmarks
Disease Classification9 benchmarks57 results
Drug Discovery1 benchmarks
Medical Image Segmentation4 benchmarks26 results

Methodology

Continual Learning1 benchmarks
Few-Shot Learning1 benchmarks
Self-Supervised Learning1 benchmarks
Transfer Learning1 benchmarks

Mobile Development

React Native Code Generation1 benchmarks40 results

Natural Language Processing

Natural Language Inference1 benchmarks8 results
Polish Conversation Quality1 benchmarks450 results
Polish Cultural Competency1 benchmarks1155 results
Polish Emotional Intelligence1 benchmarks101 results
Polish LLM General1 benchmarks3728 results
Polish Text Understanding1 benchmarks465 results
Reading Comprehension1 benchmarks

Other

Other4 benchmarks

Reasoning

Arithmetic Reasoning2 benchmarks6 results
Commonsense Reasoning6 benchmarks82 results
Logical Reasoning4 benchmarks12 results
Mathematical Reasoning4 benchmarks79 results
Multi-step Reasoning4 benchmarks53 results

Reinforcement Learning

Continuous Control1 benchmarks9 results
Offline RL1 benchmarks

Robots

Robot Manipulation1 benchmarks
Robot Navigation1 benchmarks
Sim-to-Real Transfer1 benchmarks

Speech

Speaker Verification1 benchmarks3 results
Speech Translation1 benchmarks3 results

Time-series

Time-series classification1 benchmarks