Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Sparse Autoencoder Feature Evaluation on OpenWebText 1B tokens (Gemma-2-2B train)
Loading...
0.9631
KL Score
TopK
0.959668
0.960559
0.96145
0.962341
Jun 29, 2026
KL Score
Interp
Composition
Absorption
Split
Updated 25d ago
Evaluation Results
Method
Method
Links
KL Score
Interp
Composition
Absorption
Split
TopK
Model=Gemma-2-2B, Laye...
2026.06
0.9631
0.9196
0.3416
0.2987
1.2692
C2R
Model=Gemma-2-2B, Laye...
2026.06
0.9631
0.9302
0.087
0.0654
1.0385
Ort
Model=Gemma-2-2B, Laye...
2026.06
0.9629
0.9072
0.1053
0.1058
1.0385
Batch TopK
Model=Gemma-2-2B, Laye...
2026.06
0.9621
0.9313
0.343
0.2149
1.1538
Matryoshka
Model=Gemma-2-2B, Laye...
2026.06
0.9598
0.887
0.1892
0.0241
1.0769
Feedback
Search any
task
Search any
task