Share your thoughts, 1 month free Claude Pro on usSee more

Semantic Textual Similarity on STS Benchmark Suite

72.24STS-12 Score

ECHO w/ ReverseEOL

Updated 1mo ago

Evaluation Results

Method
ECHO w/ ReverseEOL 2026.06	72.24	84.69	75.15	83.29	81.1	81.98	74.93	79.05
Pretended CoT w/ ReverseEOL 2026.06	72.2	85.51	77.51	83.92	82.1	82.8	74.5	79.79
Knowledge w/ ReverseEOL 2026.06	71.5	85.56	77.39	83.74	82.3	82.51	75.98	79.85
Pretended CoT w/ ReverseEOL 2026.06	71.04	83.28	74.91	81.45	81.51	79.3	73.86	77.91
PromptEOL w/ ReverseEOL 2026.06	70.71	84.57	76.14	83.39	80.65	81.72	73.64	78.69
Prompt A w/ ReverseEOL 2026.06	70.6	81.23	73.71	81.17	80.14	79.42	74.76	77.29
PromptEOL w/ ReverseEOL 2026.06	70.53	82.71	74.66	81.56	81.84	79.6	73.81	77.82
Prompt A w/ ReverseEOL 2026.06	70.03	82.53	74.63	82.16	78.74	79.31	75.14	77.51
PromptEOL w/ ReverseEOL 2026.06	69.61	82.01	73.8	81.55	79.11	79.13	74.15	77.05
ECHO w/ ReverseEOL 2026.06	69.16	82.58	73.52	81.76	79.58	78.83	74.72	77.16
Pretended CoT w/ ReverseEOL 2026.06	68.58	80.05	72.59	79.93	77.94	77.26	75.09	75.92
ECHO w/ ReverseEOL 2026.06	68.4	80.69	71.63	80.84	78.59	77.78	73.44	75.91
ECHO 2026.06	68.12	80.13	71.58	79.3	77.4	77.2	72.76	75.21
Prompt A w/ ReverseEOL 2026.06	67.82	82.51	74.72	81.6	79.48	79.2	72.96	76.9
Pretended CoT 2026.06	67.76	83.87	74.73	79.94	80.85	79.86	73.59	77.23
ECHO 2026.06	67.38	81.08	71.2	78.92	77.61	77.82	72.21	75.17
Pretended CoT w/ ReverseEOL 2026.06	67.2	81.3	71.35	80.23	78.55	72.43	67.16	74.03
Knowledge w/ ReverseEOL 2026.06	67.18	83.5	74.16	81.27	80.43	76.48	72.36	76.48
Knowledge w/ ReverseEOL 2026.06	66.74	79.61	71.55	80.01	75.95	75.96	74.4	74.89
Pretended CoT 2026.06	66.71	78.59	71.21	77.12	76.02	77.2	72.81	74.24
PromptEOL 2026.06	66.56	80.65	71.74	79.25	77.59	78.74	72.93	75.35
PromptEOL w/ ReverseEOL 2026.06	66.46	82.42	72.22	80.24	78.89	73.39	68.33	74.56
Pretended CoT 2026.06	66.45	82.04	72.24	77.93	79.36	76.66	71.06	75.11
Prompt A w/ ReverseEOL 2026.06	65.95	77.83	67.14	78.06	75.01	73.03	69.55	72.37
Prompt A 2026.06	65.74	79.97	73	78.65	78.21	78.19	74.24	75.43
PromptEOL 2026.06	65.73	80.77	72.05	78.09	79	77.69	71.22	74.94
Knowledge 2026.06	65.6	82.82	74.48	80.75	80.13	80.34	75.89	77.14
Knowledge w/ ReverseEOL 2026.06	65.34	83.76	74.72	80.33	79.85	75.14	73.09	76.03
Prompt A 2026.06	65.33	80.23	71.69	79.61	75.45	76.75	73.21	74.61
Prompt B w/ ReverseEOL 2026.06	65.23	78.89	68.56	78.3	74.77	73.16	68.61	72.5
Prompt B w/ ReverseEOL 2026.06	65.16	82.67	72.43	79.81	77.34	74.18	67.13	74.1
PromptEOL 2026.06	64.36	82.05	72.21	78.88	77.35	76.8	72.52	74.88
ECHO 2026.06	62.97	79.65	69.97	77.11	75.57	76.26	71.65	73.31
Knowledge 2026.06	62.76	77.25	69.1	77.64	73.52	74.88	72.43	72.51
ECHO w/ ReverseEOL 2026.06	62.48	80.74	68.79	77.21	75.93	68.66	66.53	71.48
Prompt A 2026.06	62.26	80.17	71.38	76.93	77	75.86	71.05	73.52
Prompt B 2026.06	60.9	77.38	63.29	73.2	73.08	69.79	68.48	69.45
Knowledge 2026.06	60.33	81.52	71.73	77.53	77.99	74.09	74.02	73.89
Prompt A 2026.06	60	75.89	63.66	75.09	73.07	72.98	69.97	70.09
Knowledge 2026.06	59.88	81.9	70.51	78.49	79.53	75.53	71.75	73.94
Pretended CoT 2026.06	57.89	78.04	65.02	75.24	76.89	68.3	64.81	69.46
Prompt B w/ ReverseEOL 2026.06	57.78	76.6	64.93	74.91	74.79	68.99	67.26	69.32
Prompt B w/ ReverseEOL 2026.06	57.29	78.07	64.5	73.1	75.16	62.36	63.37	67.69
PromptEOL 2026.06	56.63	79.23	67.03	75.06	76.1	68.62	65.18	69.69
Prompt B 2026.06	56.31	79.8	67.32	73.67	71.9	67.44	64.32	68.68
ECHO 2026.06	50.87	77.33	61.91	70.62	71.41	61.62	63.76	65.36
Prompt B 2026.06	49.59	75.05	61.77	69.38	68.42	63.76	66.03	64.86
Prompt B 2026.06	41.47	75.65	59.87	64.44	68.41	48.67	58.71	59.6