Codesota · Computer Vision · Image Classification · ImageNet-RTasks/Computer Vision/Image Classification
Image Classification · benchmark dataset · EN

ImageNet-R (ImageNet-Rendition).

ImageNet-R (ImageNet-Rendition) is a robustness / out-of-distribution evaluation dataset consisting of artistic and non-photorealistic renditions of ImageNet classes. It contains renditions such as art, cartoons, deviantart, graffiti, embroidery, graphics, origami, paintings, patterns, plastic objects, plush objects, sculptures, sketches, tattoos, toys, and video game renderings. The dataset covers 200 ImageNet class WordNet IDs (the same label space as ImageNet) and contains about 30,000 images. It was created to test ImageNet-trained models’ robustness to style/domain shifts and to evaluate performance on non-photorealistic renditions of the same object classes (introduced as part of the datasets in Hendrycks et al., “The Many Faces of Robustness”).

Paper Submit a result
§ 01 · Leaderboard

Best published scores.

No results indexed yet — be the first to submit a score.

No benchmark results indexed yet
§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies