classic.

Dataset from Papers With Code

Submit a result ↵

§ 01 · Leaderboard

Best published scores.

2 results indexed across 1 metric. Shaded row marks current SOTA; ties broken by submission date.

Primary: accuracy · higher is better

accuracy· primary

2 rows

#	Model	Org	Submitted	Paper / code	accuracy
01	REL-RWMD k-NN	—	Dec 2019	Speeding up Word Mover's Distance and its variants via p… · code	96.85
02	ApproxRepSet	—	Apr 2019	Rep the Set: Neural Networks for Learning Set Representa… · code	96.24

Fig 2 · Rows sorted by score within each metric. Shaded row marks SOTA. Dates reflect model or paper release where available, otherwise the date Codesota accessed the source.

§ 03 · Progress

2 steps
of state of the art.

Each row below marks a model that broke the previous record on accuracy. Intermediate submissions are kept in the leaderboard above; only SOTA-setting entries are re-listed here.

Higher scores win. Each subsequent entry improved upon the previous best.

SOTA line · accuracy

Apr 3, 2019ApproxRepSet96.24
Dec 1, 2019REL-RWMD k-NN96.85

Fig 3 · SOTA-setting models only. 2 entries span Apr 2019 → Dec 2019.

§ 04 · Literature

2 papers
tied to this benchmark.

Every paper below corresponds to at least one row in the leaderboard above. Click through for the arXiv preprint and, when available, the reference implementation.

Speeding up Word Mover's Distance and its variants via properties of distances between embeddings
Dec 2019·REL-RWMD k-NN
arXiv ↗Code
Rep the Set: Neural Networks for Learning Set Representations
Apr 2019·ApproxRepSet
arXiv ↗Code

§ 06 · Contribute

Have a score that beats
this table?

Submit a checkpoint and a reproduction script. We will run it, publish the score, and — if it takes the top — annotate the step on the progress chart with your name.

Submit a result ↵Read submission guide

What a submission needs

01A public checkpoint or API endpoint
02A reproduction script with frozen commit + seed
03Declared evaluation environment (Python, deps)
04One row per metric declared by this dataset
05A contact so we can follow up on discrepancies

classic.

Best published scores.

2 stepsof state of the art.

2 paperstied to this benchmark.

Neighbouring benchmarks.

Have a score that beatsthis table?

2 steps
of state of the art.

2 papers
tied to this benchmark.

Have a score that beats
this table?