Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HiTab

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringHiTab
Accuracy94.1
121
Table Question AnsweringHiTab
F1 Score84.41
50
Table Question AnsweringHiTab
Accuracy64.71
30
Question AnsweringHiTab (held-in)
Accuracy58.2
21
Hierarchical Table Question AnsweringHiTab (test)
Accuracy (%)76.08
15
Hierarchical Table Question AnsweringHiTab
Accuracy87.24
11
Question AnsweringHiTab (test)
Accuracy63
11
Text GenerationHiTab T2T
BLEU16.96
11
Question AnsweringHiTab
Accuracy70.5
10
Table Question AnsweringHiTab (test)
Exact Match64
8
Table Question AnsweringHiTab Subset (test)
EM68.37
6
Table-to-text generationHiTab (test)
BLEU16.3
6
Table Question AnsweringHiTab (test)
Execution Accuracy47
5
Table Question AnsweringHiTab (dev)
Execution Accuracy48.8
5
Table Question AnsweringHiTab (dev)
Accuracy63.51
4
Tabular Question AnsweringHiTab
Question Answering Latency (s)6.19
3
Table structure recognitionHiTab I (held-in)
TEDS Score54
3
Showing 17 of 17 rows