Our new X account is live! Follow @wizwand_team for updates

Semantic Textual Similarity

Benchmarks

Dataset Name	SOTA Method	Metric
STS tasks (STS12, STS13, STS14, STS15, STS16, STS-B, SICK-R) various (test)	SimCSE-BERT	STS12 Score82.4	393	3d ago
STS tasks (STS12, STS13, STS14, STS15, STS16, STS-B, SICK-R)	ModernBERT_emb	STS12 Score80.67	195	3d ago
STS-B	UD+-XXL	Spearman's Rho (x100)92.9	70	3d ago
English STS	TENC-mutual ensemble	Average Score83.07	68	3d ago
STS (Semantic Textual Similarity) 2012-2016 (test)	SimCSE + MixSP	STS-12 Score81.08	57	3d ago
STS 2014	BERT-NLI-STSb-large	Spearman Correlation0.8877	35	3d ago
SICK Slovak (val)		Pearson Correlation0.778	33	3d ago
STS Benchmark Slovak (val)		Pearson Correlation0.824	33	3d ago
STS-12	S-ROBERTa (base)	Spearman Correlation (rho)0.7154	23	3d ago
CDSC-R (test)	DiffAug + MixSP	Spearman's Correlation0.8545	22	3d ago
CDSC-R (val)	DiffAug + MixSP	Spearman Correlation88.28	22	3d ago
BIOSSES	SimCSE + MixSP	Spearman Correlation82.61	22	3d ago
STS Benchmark (dev)	UNIMO	Pearson Correlation (r)0.926	21	3d ago
MedSTS		Pearson Correlation0.7598	17	3d ago
STSB	SPARSE	Leakage2.68	16	3d ago
STS Benchmark (test)	Prompt-based FT (hard) + PCP	Pearson Correlation (r)0.919	16	3d ago
SemEval-2022 Task 2 Idiomatic STS (evaluation)	Adaptive Contrastive Triplet Loss	Spearman Rho (All)0.69	14	3d ago
SICK (test)	USE	Spearman Correlation0.7669	12	3d ago
STS16 (test)	DINO (STS-A-x2)	Spearman Corr77.18	12	3d ago
STS15 (test)	DINO (STS-A-x2)	Spearman Correlation0.8049	12	3d ago
STS14 (test)	S-BERT (base)	Spearman Correlation0.7319	12	3d ago
STS13 (test)	DINO (STS-A-x2)	Spearman Correlation81.26	12	3d ago
STS Benchmarks (STSB, FinPara, SICK-R, SemRel24, STS12, STS13, STS14, STS15, STS17, STS22) (test)	UEC	STSB Score87.55	11	3d ago
QBQTC	LLM-ce-ft(7B)	Pearson Correlation0.3414	11	3d ago
AFQMC	LLM-ce-ft(7B)	Pearson Correlation0.4284	11	3d ago

Showing 25 of 55 rows