Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning Quality Evaluation on EmoArt salience extension (test)

87.42Dice (Sample Mean)

FAB-G

Updated 16d ago

Evaluation Results

Method	Links
FAB-G 2026.05		87.42	88.08	84.5	84.54	94.92	95.89	98.59	98.18	76.83	74.64	73.39	75.47	78.79	78.5
SFT 2026.05		85.36	83.98	83.23	81.36	96.72	95.78	96.86	95.86	71.43	65.79	72.9	75.88	78.26	73.47
CoT 2026.05		78.63	77	76.27	74.18	89.09	89.09	88.55	85.42	64.71	56.7	75.15	85.4	63.87	54.29
CoT 2026.05		74.23	72.98	67.29	67.08	85.97	86.21	95.83	97.87	48.78	40	72.53	86.84	33.33	24.46
CoT 2026.05		72.49	69.54	70.65	67.31	65.61	59.73	89.14	86.99	64.57	54.09	71.76	82.88	62.18	52.86
CoT 2026.05		70.91	68.79	60.85	61.18	84.65	83.49	93.95	94.56	51.24	41.55	69.61	83.11	4.82	3.18
One-Shot 2026.05		67.55	65.42	52.76	55.42	83.53	89.81	96.19	98.44	18.95	12.97	62.57	74.27	2.53	1.61
One-Shot 2026.05		65.78	62.04	50.05	51.2	86.92	90.83	96.19	98.44	4.49	2.93	52.35	56.2	10.31	7.62
One-Shot 2026.05		59.25	52.49	44.2	41.62	69.89	62.98	95.83	97.87	10.99	7.29	41.74	38.34	2.53	1.61
One-Shot 2026.05		57.18	51.19	43.57	41.94	47.56	39.47	96.19	98.44	11.11	7.31	57.93	61.22	5.06	3.23