Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Instruction Following on SCAN around right
Loading...
99.51
Accuracy
LSTM + LEXSYM
5.0156
29.5478
54.08
78.6122
Jan 30, 2022
Accuracy
Updated 4mo ago
Evaluation Results
Method
Method
Links
Accuracy
LSTM + LEXSYM
Pre-training=None, Aug...
2022.01
99.51
LSTM + Substitute
Pre-training=None, Aug...
2022.01
99.17
GECA
Pre-training=None
2022.01
98.5
T5 + LEXSYM
Pre-training=Language...
2022.01
97.29
LexLSTM
Pre-training=None
2022.01
88.41
T5
Pre-training=Language...
2022.01
38.4
LSTM
Pre-training=None
2022.01
8.65
Feedback
Search any
task
Search any
task