Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

AQUA-RAT

Benchmarks

Task NameDataset NameSOTA ResultTrend
Mathematical ReasoningAQUA-RAT
Accuracy69.7
57
Algebraic Question AnsweringAQUA-RAT Synthetic NIID 1.0 (test)
Accuracy28
7
Algebraic Question AnsweringAQUA-RAT Synthetic IID 1.0 (test)
Accuracy29.9
7
Mathematical ReasoningAQUA-RAT STREET
Answer Accuracy78
3
Mathematical ReasoningAQUA-RAT standard (test)
ACC (%)40.16
3
Showing 5 of 5 rows