Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Modular Addition

Benchmarks

Task NameDataset NameSOTA ResultTrend
Modular AdditionModular Addition (test)
Accuracy (τ=0.1)100
64
Modular AdditionModular Addition Token Embedding
Match Accuracy99.4
36
Modular AdditionModular Addition Angular Embedding (test)
Match Accuracy0.999
36
Grokking Synchronization AnalysisModular Addition (train test)
Grok5,000
9
Grokking GeneralizationModular Addition (train/test)
Grokked Count14
8
Modular AdditionModular Addition f_train=0.5 P=97
Grokking Onset (epochs)2,460
4
Showing 6 of 6 rows