Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Pythia-160M residual-stream activations 5,000-token (test)
Loading...
0.332
Relative Error
Dense-SAE
0.31956
0.40353
0.4875
0.57147
Jul 2, 2026
Relative Error
Cross-Entropy Reconstruction
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Error
Cross-Entropy Reconstruction
Dense-SAE
Layer=8, k=64, m (Hidd...
2026.07
0.332
0.946
Expander-SAE
Layer=8, d=300, k=64,...
2026.07
0.399
0.889
Dense-SAE
Layer=4, k=64, m (Hidd...
2026.07
0.439
0.949
Expander-SAE
Layer=8, d=75, k=64, m...
2026.07
0.461
0.836
Expander-SAE
Layer=4, d=300, k=64,...
2026.07
0.515
0.901
Expander-SAE
Layer=8, d=10, k=64, m...
2026.07
0.52
0.767
Expander-SAE
Layer=4, d=75, k=64, m...
2026.07
0.588
0.836
Expander-SAE
Layer=4, d=10, k=64, m...
2026.07
0.643
0.742
Feedback
Search any
task
Search any
task