Share your thoughts, 1 month free Claude Pro on usSee more

Sequence Prediction on WikiText-2 (average)

25.07Average PPL

CTAT (Softmax-GL)

Updated 1mo ago

Evaluation Results

Method	Links
CTAT (Softmax-GL) 2026.06		25.07
Transformer-GL 2026.06		25.16
CTAT (Linear-GL) 2026.06		25.47
CTAT (Linear-FFT) 2026.06		25.47
Transformer 2026.06		27.52