Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Syntactic Evaluation on SyntaxGym Overall
Loading...
82.5
Accuracy
TG‡
40.588
51.469
62.35
73.231
Feb 20, 2024
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
TG‡
Inference Complexity=C...
2024.02
82.5
Chinchilla
Training Corpus Size=L...
2024.02
79.7
Gopher
Training Corpus Size=L...
2024.02
79.5
GPT-2
Training Corpus Size=L...
2024.02
78.4
TPT [dep.]
Inference Complexity=S...
2024.02
77.1
TPT [cons.]
Inference Complexity=S...
2024.02
75.8
PLM-mask†
Inference Complexity=C...
2024.02
74.6
PLM+
Inference Complexity=C...
2024.02
73.2
TPT [bin.]
Inference Complexity=S...
2024.02
73
TPT [zero]
Inference Complexity=S...
2024.02
71.7
TPT [seq.]
Inference Complexity=S...
2024.02
70.1
TPT [rand.]
Inference Complexity=S...
2024.02
69
PLM-mask
Comparison Category=Co...
2024.02
42.5
PLM
Comparison Category=Co...
2024.02
42.2
Feedback
Search any
task
Search any
task