Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Pythia-160M Layer 8 activations (held-out)
Loading...
0.332
Relative Reconstruction Error
Dense-SAE
0.32448
0.37524
0.426
0.47676
Jul 2, 2026
Relative Reconstruction Error
Reconstruction CE Score
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Reconstruction Error
Reconstruction CE Score
Dense-SAE
Layer=8, m=768, n=6,14...
2026.07
0.332
0.946
Expander d=300
Layer=8, m=768, n=6,14...
2026.07
0.399
0.889
Expander d=75
Layer=8, m=768, n=6,14...
2026.07
0.461
0.836
Expander d=10
Layer=8, m=768, n=6,14...
2026.07
0.52
0.767
Feedback
Search any
task
Search any
task