Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Induction on Induction Task
Loading...
16
Top-1 Accuracy (Baseline)
top-6 spectral picks (incl 3 induction heads)
3.208
6.529
9.85
13.171
May 22, 2026
Top-1 Accuracy (Baseline)
Top-1 Accuracy (Post-Ablation)
Relative Drop
Updated 8d ago
Evaluation Results
Method
Method
Links
Top-1 Accuracy (Baseline)
Top-1 Accuracy (Post-Ablation)
Relative Drop
top-6 spectral picks (incl 3 induction heads)
Model=Karpathy 124M
2026.05
16
0.85
-95
mech-interp-classified L8H2 + L5H0
Model=Pythia 160M
2026.05
4.7
0.05
-99
top-6 spectral picks (mostly self/prev)
Model=Pythia 410M
2026.05
3.7
2.1
-43
mech-interp-classified + 2nd-class induction
Model=Pythia 410M
2026.05
3.7
0.85
-77
all heads with induction sel ≥ 50× (11 heads)
Model=Pythia 410M
2026.05
3.7
0
-100
Feedback
Search any
task
Search any
task