Share your thoughts, 1 month free Claude Pro on usSee more

In-Context Learning on Garg ICL d=20 2022 (held-out tasks)

0.989R2

Transformer (continuous attn)

Updated 22d ago

Evaluation Results

Method	Links
Transformer (continuous attn) 2026.07		0.989
DendriCNN (continuous ablation) 2026.07		0.833
DendriCL (single-layer) 2026.07		0.82
DendriCL (single-layer) 2026.07		0.805
DendriCL (L = 2) 2026.07		0.793
Spikformer (spike attn) 2026.07		0.724
Pure LIF 2026.07		0.086
Active Dendrites 2026.07		0.061
GRU 2026.07		0.058
LSNN 2026.07		0.008