Share your thoughts, 1 month free Claude Pro on usSee more

Semantic Similarity

Benchmarks

Dataset Name	SOTA Method	Metric
SimLex	Concepts	Spearman Correlation0.1844	60	3mo ago
MRPC (test)	FFT	Test Accuracy91.3	24	1mo ago
Semantic Similarity Cross-lingual XL	VMSST	Pearson Correlation Coefficient0.791	24	4mo ago
SICK	MRL	Accuracy652.1	21	1mo ago
STS-B (test)	SimCSE-ROBERTa	Semantic Consistency80.22	18	4mo ago
BQ syntactically perturbed		Accuracy79.26	17	3mo ago
AFQMC syntactically perturbed	SyCo	Accuracy94.27	17	3mo ago
LCQMC	SyCo	Accuracy83.6	17	3mo ago
WIKI (test)	Llama3-8B-Instruct	BLEU-455.52	17	4mo ago
ICEWS18 (test)	Llama3-8B-Instruct	BLEU-440.39	17	4mo ago
Semantic Similarity Cross-lingual same language XL s.	VMSST	Pearson's r0.815	12	4mo ago
Semantic Similarity English-only	VMSST	Pearson's r74.6	12	4mo ago
USEB (Universal Sentence Encoder Benchmark)	SGPT-2.7B	AskU AP57.5	12	4mo ago
Crisscrossed Captions (CxC)	DE-T2T+I2T	Mean Average74.5	10	4mo ago
QQP Dir(0.1) (test)	GLoRA	Accuracy88.28	8	2mo ago
New Zealand English (NZE) hypocoristic word pairs (yarn-conversation)	XLM-RoBERTa	Cosine Similarity0.995	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs (tramp-hike)		Cosine Similarity0.987	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs snag-sausage	XLM-RoBERTa	Cosine Similarity0.992	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs (raro-cordial)	XLM-RoBERTa	Cosine Similarity0.992	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs fizzy-soda	XLM-RoBERTa	Cosine Similarity0.99	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs (dairy-superette)	XLM-RoBERTa	Cosine Similarity0.983	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs (bog-toilet)		Cosine Similarity0.993	8	3mo ago
New Zealand English (NZE) hypocoristic word pairs (banger-sausage)	XLM-RoBERTa	Cosine Similarity0.982	8	3mo ago
π-YALLI corpus Nawatl	FastText Skipgram	Kendall's Tau (1x)0.459	8	3mo ago
QQP	RegMix	Accuracy51.58	7	1mo ago

Showing 25 of 31 rows