Who leads the howsumm-step benchmark?

Oracle-BERT currently leads howsumm-step with a score of 46.8 on Rouge 1.

What is the state-of-the-art score on howsumm-step?

The state-of-the-art result on howsumm-step is 46.8 (Rouge 1), achieved by Oracle-BERT as of 2021.

How many models are tracked on howsumm-step?

Codesota tracks 16 models on howsumm-step.

When was the howsumm-step leaderboard last updated?

The howsumm-step leaderboard on Codesota includes results through 2021.

Codesota · Benchmark · howsumm-stepHome/Leaderboards/Vision & Documents/Document OCR/howsumm-step

Unknown

howsumm-step.

Name: howsumm-step Benchmark Results
Creator: Unknown
Published: 2021-01-01
License: https://creativecommons.org/licenses/by/4.0/

howsumm-step is a state-of-the-art machine learning benchmark indexed on Codesota. This page tracks published model results, top scores per metric, and the SOTA timeline for howsumm-step.

Paper ↗Leaderboard ↓

§ 01 · Leaderboard

Results by metric.

Found a wrong score or missing run?

Use row edits to send a sourced correction into moderation.

Add / edit result ↗Report issue ↗

Rouge 1

Rouge 1 is the reported evaluation metric for howsumm-step. Codesota tracks published model scores on this metric so readers can compare state-of-the-art results across sources and model families.

Higher is better

Trust tiers for Rouge 1verifiedpapervendorcommunityunverified

Rank	Model	Trust	Score	Year	Links	Fix
01	Oracle-BERT From Table 4: Oracle-BERT extractive upper bound. ROUGE-1 Recall.	verified	46.8	2021	Paper ↗Code ↗	Looks wrong?
02	Oracle-BOW From Table 4: Oracle-BOW extractive upper bound. ROUGE-1 Recall.	verified	46	2021	Paper ↗Code ↗	Looks wrong?
03	LexRank (query: step title) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	39.6	2021	Paper ↗Code ↗	Looks wrong?
04	CES (query: step title) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	39.3	2021	Paper ↗Code ↗	Looks wrong?
05	CES (query: step + method titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	38.3	2021	Paper ↗Code ↗	Looks wrong?
06	LexRank (query: step + method titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	38.2	2021	Paper ↗Code ↗	Looks wrong?
07	CES (query: step + method + article titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	37	2021	Paper ↗Code ↗	Looks wrong?
08	LexRank (query: step + method + article titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	36.3	2021	Paper ↗Code ↗	Looks wrong?
09	Oracle-HierSumm From Table 4: Oracle-HierSumm extractive upper bound. ROUGE-1 Recall.	verified	35.6	2021	Paper ↗Code ↗	Looks wrong?
10	GreedyRel (query: step + method titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	30.3	2021	Paper ↗Code ↗	Looks wrong?
11	GreedyRel (query: step + method + article titles) From Table 3: query = step + method + article titles. ROUGE-1 Recall.	verified	30.1	2021	Paper ↗Code ↗	Looks wrong?
12	GreedyRel (query: step title) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	30.1	2021	Paper ↗Code ↗	Looks wrong?
13	Random Baseline (HowSumm) From Table 4: random baseline. ROUGE-1 Recall.	verified	23	2021	Paper ↗Code ↗	Looks wrong?
14	BM25-HierSumm (query: step + method titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	23	2021	Paper ↗Code ↗	Looks wrong?
15	BM25-HierSumm (query: step title) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	22.3	2021	Paper ↗Code ↗	Looks wrong?
16	BM25-HierSumm (query: step + method + article titles) From paper: HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles	verified	21.9	2021	Paper ↗Code ↗	Looks wrong?

§ 04 · Submit a result

Add to the leaderboard.

← Back to Document OCR