Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WikiTableQuestions

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringWikiTableQuestions (test)
Accuracy76.6
86
Excel Formula GenerationWikiTableQuestions (WikiTQ) 639 problems solvable in Excel (test)
Execution Match (EM)84.19
51
Table-based Question AnsweringWikiTableQuestions (dev)
Accuracy64.8
25
Table Question AnsweringWikiTableQuestions OOD
Accuracy83.34
18
Table Question AnsweringWikiTableQuestions (WTQ) T (original tables) (sampled subset)
Accuracy73.65
18
Semantic ParsingWIKITABLEQUESTIONS (test)
Execution Accuracy (Best)52.3
17
Semantic ParsingWIKITABLEQUESTIONS (dev)
Execution Accuracy (Best)53
16
Table-based Question AnsweringWikiTableQuestions 17 (test)
Accuracy80.8
12
Table Question AnsweringWikiTableQuestions (WTQ) complete (test)
Accuracy73.6
11
Table Question AnsweringWikiTableQuestions (WTQ) (test)
Accuracy46.59
5
Table Question AnsweringWikiTableQuestions
Accuracy76.2
5
Document-oriented Visual Question AnsweringWikiTableQuestions (WTQ) (test)
Accuracy25.3
2
Showing 12 of 12 rows