Our new X account is live! Follow @wizwand_team for updates

Language Modeling on WikiText-103 small setting (test)

32.8Perplexity

Delta RNN

Updated 4d ago

Evaluation Results

Method	Links
Delta RNN 2021.06		32.8
RDN 2021.06		33.6
Delta LSTM 2021.06		33.8
Transformer 2021.06		34.1
Delta RNN 2021.06		35
Delta Net 2021.06		35.2
Delta Delta Net 2021.06		35.2
RDN 2021.06		35.2
Delta MLP 2021.06		36.8
Linear Transformer 2021.06		38.3