Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HiTab

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Question AnsweringHiTab
Accuracy94.1
121
Table Question AnsweringHiTab
F1 Score84.41
50
Table Question AnsweringHiTab
Accuracy64.71
30
Question AnsweringHiTab (held-in)
Accuracy58.2
21
Table ReasoningHiTab
Accuracy80.17
18
Hierarchical Table Question AnsweringHiTab (test)
Accuracy (%)76.08
15
Hierarchical Table Question AnsweringHiTab
Accuracy87.24
11
Question AnsweringHiTab (test)
Accuracy63
11
Text GenerationHiTab T2T
BLEU16.96
11
Question AnsweringHiTab
Accuracy70.5
10
Table Question AnsweringHiTab (test)
Exact Match64
8
Table Question AnsweringHiTab Subset (test)
EM68.37
6
Table-to-text generationHiTab (test)
BLEU16.3
6
Table Question AnsweringHiTab (test)
Execution Accuracy47
5
Table Question AnsweringHiTab (dev)
Execution Accuracy48.8
5
Table Question AnsweringHiTab (dev)
Accuracy63.51
4
Tabular Question AnsweringHiTab
pass@167.1
3
Tabular Question AnsweringHiTab
Question Answering Latency (s)6.19
3
Table structure recognitionHiTab I (held-in)
TEDS Score54
3
Showing 19 of 19 rows