Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning Quality Assessment on TheoremQA

0.873AUROC

TRACED

Updated 1mo ago

Evaluation Results

Method	Links
TRACED 2026.03		0.873	0.7094	0.7625
SAPLMA 2026.03		0.8518	0.6617	0.8421
LR Probe 2026.03		0.8435	0.6497	0.8158
SAPLMA 2026.03		0.7909	0.7847	0.6327
TRACED 2026.03		0.7752	0.7314	0.6125
TRACED 2026.03		0.7638	0.6333	0.625
LR Probe 2026.03		0.7583	0.6957	0.875
LR Probe 2026.03		0.7364	0.7493	0.6455
SAPLMA 2026.03		0.6958	0.7262	0.8375
CoT-Kinetics 2026.03		0.6738	0.5951	0.8133
CoE 2026.03		0.6625	0.6242	0.7015
TRACED 2026.03		0.655	0.675	0.725
CoE 2026.03		0.6545	0.5495	0.6954
SAPLMA 2026.03		0.6471	0.6551	0.7308
CoT-Kinetics 2026.03		0.6455	0.6143	0.8394
LR Probe 2026.03		0.6435	0.6065	0.8077
Perplexity 2026.03		0.6273	0.5554	0.6364
CoE 2026.03		0.6053	0.6402	0.8474
CoT-Kinetics 2026.03		0.5754	0.5	0.85
MSP 2026.03		0.527	0.4951	0.8737
Perplexity 2026.03		0.5229	0.5552	0.8211
Perplexity 2026.03		0.5133	0.5468	0.8661
Entropy 2026.03		0.5111	0.4951	0.8737
CoE 2026.03		0.4808	0.4835	0.8503
Entropy 2026.03		0.4719	0.5318	0.8615
MSP 2026.03		0.463	0.523	0.8589
MSP 2026.03		0.4583	0.4859	0.8375
Entropy 2026.03		0.4458	0.4725	0.8375
CoT-Kinetics 2026.03		0.4417	0.5	0.8906
Perplexity 2026.03		0.3958	0.5279	0.8375
MSP 2026.03		0.3273	0.4622	0.8091
Entropy 2026.03		0.3273	0.4622	0.8091