Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Semantic Parsing on SCAN Around Right
Loading...
100
Exact-match Accuracy
SpanSub+L2S2
-1.4
24.925
51.25
77.575
Jun 5, 2023
Jul 16, 2023
Aug 27, 2023
Oct 7, 2023
Nov 18, 2023
Dec 29, 2023
Feb 9, 2024
Exact-match Accuracy
Updated 2d ago
Evaluation Results
Method
Method
Links
Exact-match Accuracy
SpanSub+L2S2
Base Model=LSTM
2023.06
100
SpanSub
Base Model=LSTM
2023.06
99.9
SQ-Transformer
Attention Protocol=SAL
2024.02
99.63
Prim2PrimX+MET
Base Model=LSTM
2023.06
97.6
LexLearn
Base Model=LSTM
2023.06
95.3
Lex Learn
2024.02
95
GECA+MAML
Base Model=LSTM
2023.06
86.2
GECA
Base Model=LSTM
2023.06
84.3
LexSym
Base Model=LSTM
2023.06
84
CGPS-RNN
2024.02
83.2
CGPS
2023.06
83.2
Transformer
Attention Protocol=SRL
2024.02
69.47
T5-11B
2023.06
49.2
Comp-IBT
2023.06
37.8
LSTM
2023.06
10.2
LSTM-RNN
2024.02
2.5
Feedback
Search any
task
Search any
task