Share your thoughts, 1 month free Claude Pro on usSee more

Faithfulness Evaluation on Racing Thoughts

0.72Faithfulness (SmolLM2 135M)

DST

Updated 1mo ago

Evaluation Results

Method	Links
DST 2025.10		0.72	0.68	0.75	0.69	0.71
Causal Tracing 2025.10		0.6	0.57	0.58	0.59	0.59
Patchscopes 2025.10		0.58	0.51	0.46	0.51	0.52
SAE 2025.10		0.58	0.64	0.43	0.52	0.54
Logit Lens 2025.10		0.56	0.43	0.5	0.48	0.49
Subseq. Tracing 2025.10		0.55	0.55	0.59	0.55	0.56
ReAGent 2025.10		0.38	0.46	0.29	0.33	0.37
Grad-SHAP 2025.10		0.33	0.37	0.31	0.28	0.32
LIME 2025.10		0.28	0.28	0.19	0.27	0.25
Attention 2025.10		0.18	0.25	0.35	0.12	0.23