Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Activation Reconstruction on Wikipedia activations Llama-3.1-8B
Loading...
0.004
MSE
MFA
0.00072
0.02286
0.045
0.06714
Feb 2, 2026
MSE
Error Ratio (vs MFA)
Updated 4d ago
Evaluation Results
Method
Method
Links
MSE
Error Ratio (vs MFA)
MFA
Layer=8, Number of Fea...
2026.02
0.004
-
MFA
Layer=8, Number of Fea...
2026.02
0.004
-
MFA
Layer=8, Number of Fea...
2026.02
0.005
-
K-Means
Layer=8, Number of Fea...
2026.02
0.005
140
K-Means
Layer=8, Number of Fea...
2026.02
0.006
140
K-Means
Layer=8, Number of Fea...
2026.02
0.007
130
SAE
Layer=8, Number of Fea...
2026.02
0.023
-
SAE
Layer=22, Number of Fe...
2026.02
0.038
-
MFA
Layer=22, Number of Fe...
2026.02
0.045
-
MFA
Layer=22, Number of Fe...
2026.02
0.051
-
MFA
Layer=22, Number of Fe...
2026.02
0.064
-
K-Means
Layer=22, Number of Fe...
2026.02
0.066
150
K-Means
Layer=22, Number of Fe...
2026.02
0.074
150
K-Means
Layer=22, Number of Fe...
2026.02
0.086
130
Feedback
Search any
task
Search any
task