Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Llama-3.2-1B Layer 6 activations (held-out)
Loading...
56.8
Relative Error
Dense-SAE
55.836
62.343
68.85
75.357
Jul 2, 2026
Relative Error
CE Reconstruction Error
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Error
CE Reconstruction Error
Dense-SAE
Layer=6, m=2,048, n=16...
2026.07
56.8
0.952
Expander d=102
Layer=6, m=2,048, n=16...
2026.07
73.2
0.816
Expander d=30
Layer=6, m=2,048, n=16...
2026.07
76
0.743
Expander d=7
Layer=6, m=2,048, n=16...
2026.07
80.9
0.576
Feedback
Search any
task
Search any
task