Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Llama-3.2-1B Layer 12 activations (held-out)
Loading...
0.499
Relative Error
Dense-SAE
0.48868
0.55834
0.628
0.69766
Jul 2, 2026
Relative Error
Cross-Entropy Reconstruction
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Error
Cross-Entropy Reconstruction
Dense-SAE
Layer=12, m=2,048, n=1...
2026.07
0.499
0.958
Expander d=102
Layer=12, m=2,048, n=1...
2026.07
0.72
0.758
Expander d=30
Layer=12, m=2,048, n=1...
2026.07
0.742
0.707
Expander d=7
Layer=12, m=2,048, n=1...
2026.07
0.757
0.608
Feedback
Search any
task
Search any
task