Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoding on Qwen2.5-3B Layer 12 activations (held-out)
Loading...
48.9
Relative Error
Dense-SAE
47.8
55.225
62.65
70.075
Jul 2, 2026
Relative Error
Cross-Entropy Reconstruction
Updated 22d ago
Evaluation Results
Method
Method
Links
Relative Error
Cross-Entropy Reconstruction
Dense-SAE
Layer=12, m=2,048, n=1...
2026.07
48.9
98.3
Expander d=102
Layer=12, m=2,048, n=1...
2026.07
68.1
91.9
Expander d=30
Layer=12, m=2,048, n=1...
2026.07
70.3
89.4
Expander d=7
Layer=12, m=2,048, n=1...
2026.07
76.4
82.8
Feedback
Search any
task
Search any
task