Codesota · Benchmark · howsumm-methodHome/Leaderboards/Vision & Documents/Document OCR/howsumm-method
Unknown

howsumm-method.

howsumm-method is a state-of-the-art machine learning benchmark indexed on Codesota. This page tracks published model results, top scores per metric, and the SOTA timeline for howsumm-method.

Paper Leaderboard
§ 01 · Leaderboard

Results by metric.

Found a wrong score or missing run?
Use row edits to send a sourced correction into moderation.
Add / edit result Report issue

Rouge 1

Rouge 1 is the reported evaluation metric for howsumm-method. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for Rouge 1verifiedpapervendorcommunityunverified
RankModelTrustScoreYearLinksFix
01Oracle-BERT (HowSumm-Method)
Oracle-BERT upper bound on HowSumm-Method. ROUGE-1 Recall. From original HowSumm paper Table 3.
verified63.22021Source ↗Looks wrong?
02Oracle-BOW (HowSumm-Method)
Oracle-BOW upper bound on HowSumm-Method. ROUGE-1 Recall. From original HowSumm paper Table 3.
verified58.92021Source ↗Looks wrong?
03LexRank (query: method + article + steps titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified53.52021Paper ↗Code ↗Looks wrong?
04CES (query: method + article + steps titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified52.22021Paper ↗Code ↗Looks wrong?
05GreedyRel (query: method + article + steps titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified48.62021Paper ↗Code ↗Looks wrong?
06CES (query: method title)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified48.42021Paper ↗Code ↗Looks wrong?
07CES (query: method + article titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified48.32021Paper ↗Code ↗Looks wrong?
08LexRank (query: method title)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified47.72021Paper ↗Code ↗Looks wrong?
09LexRank (query: method + article titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified47.12021Paper ↗Code ↗Looks wrong?
10GreedyRel (query: method title)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified43.42021Paper ↗Code ↗Looks wrong?
11GreedyRel (query: method + article titles)
From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles
verified42.32021Paper ↗Code ↗Looks wrong?
12Random Baseline (HowSumm-Method)
Random baseline on HowSumm-Method. ROUGE-1 Recall. From original HowSumm paper Table 3.
verified41.52021Source ↗Looks wrong?
§ 04 · Submit a result

Add to the leaderboard.

← Back to Document OCR