Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Pythia-70M Layer 3 activations (held-out)
Loading...
0.342
Relative Error
Dense-SAE
0.33404
0.38777
0.4415
0.49523
Jul 2, 2026
Relative Error
Cross-Entropy Reconstruction
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Error
Cross-Entropy Reconstruction
Dense-SAE
Layer=3, m=512, n=4,09...
2026.07
0.342
0.947
Expander d=200
Layer=3, m=512, n=4,09...
2026.07
0.415
0.902
Expander d=50
Layer=3, m=512, n=4,09...
2026.07
0.489
0.859
Expander d=7
Layer=3, m=512, n=4,09...
2026.07
0.541
0.817
Feedback
Search any
task
Search any
task