Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Activation Reconstruction on Wikipedia activations Gemma-2-2B
Loading...
0.592
MSE
SAE
0.31052
2.21051
4.1105
6.01049
Feb 2, 2026
MSE
Error Ratio (vs MFA)
Updated 4d ago
Evaluation Results
Method
Method
Links
MSE
Error Ratio (vs MFA)
SAE
Layer=6, Number of Fea...
2026.02
0.592
-
MFA
Layer=6, Number of Fea...
2026.02
0.8
-
MFA
Layer=6, Number of Fea...
2026.02
0.896
-
MFA
Layer=6, Number of Fea...
2026.02
1.098
-
K-Means
Layer=6, Number of Fea...
2026.02
1.104
1.4
K-Means
Layer=6, Number of Fea...
2026.02
1.265
1.4
K-Means
Layer=6, Number of Fea...
2026.02
1.53
1.4
MFA
Layer=18, Number of Fe...
2026.02
4.477
-
SAE
Layer=18, Number of Fe...
2026.02
4.595
-
MFA
Layer=18, Number of Fe...
2026.02
4.678
-
MFA
Layer=18, Number of Fe...
2026.02
5.43
-
K-Means
Layer=18, Number of Fe...
2026.02
5.966
1.3
K-Means
Layer=18, Number of Fe...
2026.02
6.622
1.4
K-Means
Layer=18, Number of Fe...
2026.02
7.629
1.4
Feedback
Search any
task
Search any
task