Paraphrase Identification

Benchmarks

Dataset Name	SOTA Method	Metric
QQP	SMP-S	Accuracy91.7	78	4mo ago
Quora Question Pairs (test)	DRCN	Accuracy91.3	72	4mo ago
PAWS-X	ByT5	Accuracy91.7	66	3mo ago
PAWS	CoLA	G(W) Error Approximation0.37	40	1mo ago
PAWS	In-Squeeze	Accuracy97.6	35	29d ago
PPDB	CaliDist_verbalized (Sa.)	ECE2.28	32	1mo ago
MRPC	Qwen2.5-14B	Delta 1-4.73	24	4mo ago
TwitterPara (test)	SBERT-supervised	TURL81.6	22	4mo ago
PAWS -> PAWS (test)		Accuracy94.1	22	4mo ago
PAWS-X (test)	FILTER	Accuracy91.4	22	2mo ago
QQP Out-of-distribution from PAWS	GAPX	Macro F170.8	20	4mo ago
PAWS -> QQP (test)	GAPX	AUROC77.7	20	4mo ago
PIT -> PAWS (test)	OODP	AUROC77.5	20	4mo ago
PAWS-X 1.0 (test)	TokAlign++	Accuracy (de)55.3	18	2mo ago
QQP few-shot zero-shot	RETROPROMPT	Accuracy74	16	4mo ago
MCEval PAWS 8K (test)	Act	Accuracy88.9	14	4mo ago
Quora Question Pairs	SA-DiffuSeq	Accuracy95.3	14	4mo ago
Quora Question Pairs (dev)	DIIN	Accuracy90.48	14	4mo ago
PAWS-X (test)	mBERT (Reference [1])	Accuracy (en)94	13	4mo ago
PAWS-X	TokAlign + LAT	Accuracy (de)54.6	12	4mo ago
WMT Out-of-distribution from PAWS	GAPX	Macro F176.4	10	4mo ago
PIT Out-of-distribution from PAWS	OODP	Macro F169.8	10	4mo ago
PAWS Out-of-distribution from PIT	GAPX	Macro F155.1	10	4mo ago
QQP Out-of-distribution from PIT	OODP	Macro F10.757	10	4mo ago
WMT Out-of-distribution from QQP	GAPX	Macro F175.5	10	4mo ago

Showing 25 of 45 rows