Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WikiTQ

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringWikiTQ (test)
Accuracy84.3
92
Table Question AnsweringWikiTQ
Accuracy91.84
65
Table Question AnsweringWikiTQ
F1 Score79.8
50
Table Question AnsweringWikiTQ (dev)
Denotation Acc58.3
18
Language-to-Code GenerationWikiTQ official (test)
Execution Accuracy74.6
12
Table ReasoningWikiTQ
Exact Match (EM)79.4
11
Language-to-Code GenerationWikiTQ official (dev)
Execution Accuracy70.9
11
Table Question AnsweringWikiTQ (challenge-set)
F1 Score74.41
10
Table ReasoningWikiTQ (T)
Accuracy65.56
10
Table ReasoningWikiTQ (D)
Accuracy0.651
10
Table Question AnsweringWikiTQ Large (>4000 tokens)
Accuracy57
8
Table Question AnsweringWikiTQ
BLEU63.19
5
Showing 12 of 12 rows