Codesota · Computer Vision · Scene Text Detection · icdar-2017-mltTasks/Computer Vision/Scene Text Detection
Scene Text Detection · benchmark dataset · 2020 · EN

icdar-2017-mlt.

Dataset from Papers With Code

Submit a result ↵
§ 01 · Leaderboard

Best published scores.

54 results indexed across 4 metrics. Shaded row marks current SOTA; ties broken by submission date.


Primary
accuracy · higher is better
All metrics
f-measure, h-mean, precision, recall
f-measure
17 rows
#ModelOrgSubmittedPaper / codef-measure
01PMTD*—Mar 2019Pyramid Mask Text Detector · code80.13
02SBD—Dec 2019Exploring the Capacity of an Orderless Box Discretizatio… · code79.47
03TextBPN++ (ResNet-50+DCN)OpenZhang et al.May 2022Arbitrary Shape Text Detection via Boundary Transformer77.48
04CharNet H-88—Oct 2019Convolutional Character Networks · code75.77
05DBNet (ResNet-50+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer74.70
06GNNets—Sep 2019Geometry Normalization Networks for Accurate Scene Text … · code74.54
07PAN—Nov 2018Mask R-CNN with Pyramid Attention Network for Scene Text…74.30
08SPCNET—Nov 2018Scene Text Detection with Supervised Pyramid Context Net… · code74.10
09CharNet R-50 —Oct 2019Convolutional Character Networks · code73.42
10PSENet-1s—Jun 2018Shape Robust Text Detection with Progressive Scale Expan… · code72.45
11Corner Localization (multi-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code72.40
12TextBPN++ (ResNet-50)OpenZhang et al. (HCIILAB)May 2022Arbitrary Shape Text Detection via Boundary Transformer72.33
13PSENet (ResNet-152)—Mar 2019Shape Robust Text Detection with Progressive Scale Expan… · code72.13
14DBNet (ResNet-18+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer71.70
15FOTS MS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code70.75
16FOTS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code67.25
17Corner Localization (single-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code66.80
h-mean
1 row
#ModelOrgSubmittedPaper / codeh-mean
01CRAFT—Apr 2019Character Region Awareness for Text Detection · code73.90
precision
18 rows
#ModelOrgSubmittedPaper / codeprecision
01PMTD*—Mar 2019Pyramid Mask Text Detector · code84.42
02Corner Localization (single-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code83.80
03TextBPN++ (ResNet-50+DCN)OpenZhang et al.May 2022Arbitrary Shape Text Detection via Boundary Transformer83.74
04DBNet (ResNet-50+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer83.10
05SBD—Dec 2019Exploring the Capacity of an Orderless Box Discretizatio… · code82.75
06DBNet (ResNet-18+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer81.90
07FOTS MS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code81.86
08CharNet H-88—Oct 2019Convolutional Character Networks · code81.27
09FOTS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code80.95
10CRAFT—Apr 2019Character Region Awareness for Text Detection · code80.60
11SPCNET—Nov 2018Scene Text Detection with Supervised Pyramid Context Net… · code80.60
12TextBPN++ (ResNet-50)OpenZhang et al. (HCIILAB)May 2022Arbitrary Shape Text Detection via Boundary Transformer80.49
13PAN—Nov 2018Mask R-CNN with Pyramid Attention Network for Scene Text…80
14GNNets—Sep 2019Geometry Normalization Networks for Accurate Scene Text … · code79.63
15CharNet R-50 —Oct 2019Convolutional Character Networks · code77.07
16PSENet-1s—Jun 2018Shape Robust Text Detection with Progressive Scale Expan… · code77.01
17PSENet (ResNet-152)—Mar 2019Shape Robust Text Detection with Progressive Scale Expan… · code75.35
18Corner Localization (multi-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code74.30
recall
18 rows
#ModelOrgSubmittedPaper / coderecall
01SBD—Dec 2019Exploring the Capacity of an Orderless Box Discretizatio… · code76.44
02PMTD*—Mar 2019Pyramid Mask Text Detector · code76.25
03TextBPN++ (ResNet-50+DCN)OpenZhang et al.May 2022Arbitrary Shape Text Detection via Boundary Transformer72.10
04CharNet H-88—Oct 2019Convolutional Character Networks · code70.97
05Corner Localization (multi-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code70.60
06CharNet R-50 —Oct 2019Convolutional Character Networks · code70.10
07GNNets—Sep 2019Geometry Normalization Networks for Accurate Scene Text … · code70.06
08PAN—Nov 2018Mask R-CNN with Pyramid Attention Network for Scene Text…69.80
09PSENet (ResNet-152)—Mar 2019Shape Robust Text Detection with Progressive Scale Expan… · code69.18
10SPCNET—Nov 2018Scene Text Detection with Supervised Pyramid Context Net… · code68.60
11PSENet-1s—Jun 2018Shape Robust Text Detection with Progressive Scale Expan… · code68.40
12CRAFT—Apr 2019Character Region Awareness for Text Detection · code68.20
13DBNet (ResNet-50+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer67.90
14TextBPN++ (ResNet-50)OpenZhang et al. (HCIILAB)May 2022Arbitrary Shape Text Detection via Boundary Transformer65.67
15DBNet (ResNet-18+DCN)OpenLiao et al. (USTC)May 2022Arbitrary Shape Text Detection via Boundary Transformer63.80
16FOTS MS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code62.30
17FOTS—Jan 2018FOTS: Fast Oriented Text Spotting with a Unified Network · code57.51
18Corner Localization (single-scale)—Feb 2018Multi-Oriented Scene Text Detection via Corner Localizat… · code55.60
Fig 2 · Rows sorted by score within each metric. Shaded row marks SOTA. Dates reflect model or paper release where available, otherwise the date Codesota accessed the source.
§ 04 · Literature

12 papers
tied to this benchmark.

Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.

§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result ↵Read submission guide
What a submission needs
  • 01A public checkpoint or API endpoint
  • 02A reproduction script with frozen commit + seed
  • 03Declared evaluation environment (Python, deps)
  • 04One row per metric declared by this dataset
  • 05A contact so we can follow up on discrepancies
icdar-2017-mlt — Scene Text Detection | CodeSOTA