Share your thoughts, 1 month free Claude Pro on usSee more

Sentence Relatedness on STS 2014 (Domain Correlations)

0.69News Spearman

CPHRASE

Updated 1mo ago

Evaluation Results

Method
CPHRASE 2016.02	0.69	0.71	0.43	0.41	0.76	0.73	0.6	0.65	0.75	0.79	0.6	0.65	0.65	0.67
Fixed NTEE 2017.05	0.69	0.72	0.46	0.47	0.78	0.75	0.67	0.74	0.74	0.78	0.61	0.65	-	-
Fixed NTEE 2017.05	0.69	0.72	0.47	0.47	0.78	0.75	0.67	0.73	0.74	0.77	0.61	0.65	-	-
NTEE 2017.05	0.68	0.74	0.55	0.56	0.74	0.72	0.66	0.75	0.77	0.82	0.63	0.69	-	-
NTEE 2017.05	0.68	0.74	0.51	0.52	0.69	0.66	0.66	0.74	0.72	0.77	0.61	0.68	-	-
Skip-gram 2017.05	0.67	0.65	0.39	0.36	0.69	0.62	0.66	0.65	0.56	0.54	0.6	0.62	-	-
DictRep BOW+embs. 2016.02	0.65	0.72	0.49	0.47	0.85	0.86	0.67	0.72	0.71	0.74	0.57	0.61	0.67	0.7
Skip-gram 2017.05	0.65	0.63	0.39	0.36	0.69	0.61	0.62	0.62	0.57	0.56	0.58	0.6	-	-
DictRep BOW 2016.02	0.62	0.67	0.42	0.4	0.81	0.81	0.62	0.66	0.66	0.68	0.53	0.58	0.62	0.65
CBOW 2017.05	0.59	0.58	0.36	0.35	0.64	0.57	0.68	0.7	0.55	0.54	0.53	0.57	-	-
FastSent 2016.02	0.58	0.59	0.41	0.36	0.74	0.7	0.63	0.66	0.74	0.78	0.57	0.59	0.63	0.64
Siamese CBOW 2017.05	0.58	0.59	0.42	0.41	0.66	0.61	0.71	0.73	0.65	0.65	0.63	0.64	-	-
CBOW 2016.02	0.57	0.61	0.43	0.44	0.72	0.69	0.71	0.75	0.71	0.73	0.55	0.59	0.64	0.65
Skipgram 2016.02	0.56	0.59	0.42	0.42	0.73	0.7	0.71	0.74	0.65	0.67	0.55	0.58	0.62	0.63
FastSent+AE 2016.02	0.56	0.59	0.41	0.4	0.69	0.64	0.7	0.74	0.63	0.65	0.58	0.6	0.62	0.62
SAE+embs. 2016.02	0.52	0.54	0.22	0.23	0.6	0.55	0.6	0.6	0.64	0.64	0.41	0.41	0.42	0.43
SDAE+embs. 2016.02	0.51	0.54	0.29	0.29	0.56	0.5	0.57	0.58	0.59	0.59	0.43	0.44	0.37	0.38
DictRep RNN+embs. 2016.02	0.51	0.6	0.29	0.27	0.8	0.81	0.44	0.47	0.65	0.7	0.42	0.46	0.54	0.57
Unigram TFIDF 2016.02	0.48	0.48	0.4	0.38	0.6	0.59	0.63	0.65	0.72	0.74	0.49	0.49	0.58	0.57
NMT En to De 2016.02	0.47	0.43	0.26	0.25	0.34	0.31	0.49	0.45	0.44	0.43	0.38	0.37	0.4	0.38
SkipThought 2016.02	0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	0.27	0.29
Skip-thought 2017.05	0.44	0.45	0.14	0.15	0.39	0.34	0.42	0.43	0.55	0.6	0.43	0.44	-	-
Paragraph Vec DM 2016.02	0.42	0.46	0.33	0.34	0.51	0.48	0.54	0.57	0.32	0.3	0.46	0.47	0.44	0.44
DictRep RNN 2016.02	0.4	0.46	0.26	0.23	0.78	0.78	0.42	0.42	0.56	0.56	0.38	0.4	0.49	0.5
NMT En to Fr 2016.02	0.35	0.32	0.18	0.18	0.47	0.43	0.55	0.53	0.44	0.45	0.43	0.43	0.43	0.42
Paragraph Vec DBOW 2016.02	0.31	0.34	0.32	0.32	0.53	0.5	0.43	0.46	0.46	0.44	0.39	0.41	0.42	0.43
CaptionRep BOW 2016.02	0.26	0.26	0.29	0.22	0.5	0.35	0.37	0.31	0.78	0.81	0.39	0.36	0.46	0.42
SAE 2016.02	0.17	0.16	0.12	0.12	0.3	0.23	0.28	0.22	0.49	0.46	0.13	0.11	0.12	0.13
SDAE 2016.02	0.07	0.04	0.11	0.13	0.33	0.24	0.44	0.42	0.44	0.38	0.36	0.36	0.17	0.15
CaptionRep RNN 2016.02	0.05	0.05	0.13	0.09	0.4	0.33	0.36	0.3	0.76	0.82	0.3	0.28	0.39	0.36