Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TabFact

Benchmarks

Task NameDataset NameSOTA ResultTrend
Table Fact VerificationTabFact (test)
Accuracy93.73
136
Table Fact VerificationTabFact
Accuracy0.9506
104
Fact VerificationTabFact
Accuracy92.1
83
Table Fact VerificationTABFACT small (test)
Accuracy0.921
57
Table-based Fact VerificationTabFact
Accuracy81.37
49
Table Fact VerificationTABFACT complex (test)
Accuracy85.6
39
Table Fact VerificationTABFACT simple (test)
Accuracy96.7
39
Table Fact VerificationTabFact (dev)
Accuracy85.1
28
Table-based Fact VerificationTabFact small 1.0 (test)
Accuracy93
26
Multimodal Question AnsweringTabFact
F1-Recall52.6
22
Fact VerificationTabFact (held-in)
Accuracy85.02
21
Table Fact VerificationTABFACT (val)
Accuracy89.2
21
Table Fact VerificationTabFact small
Overall Accuracy85.77
18
Binary ClassificationTABFACT (test)
Accuracy81.6
18
Binary ClassificationTABFACT small (test)
Accuracy84.6
17
Binary ClassificationTABFACT complex (test)
Accuracy75.9
17
Binary ClassificationTABFACT simple (test)
Accuracy93.3
17
Table Fact VerificationTabFact full
Simple Accuracy90.09
16
Table Fact VerificationTabFact full (test)
Simple Accuracy90.09
16
Table Visual Question AnsweringTabFact (test)
Accuracy0.832
15
Table-based Fact VerificationTabFact simple 1.0 (test)
Accuracy93.6
12
Table-based Fact VerificationTabFact 1.0 (test)
Accuracy65.3
12
Table-based Fact VerificationTabFact 1.0 (val)
Accuracy66.1
12
Table ReasoningTabFact S
Accuracy88.93
10
Table-based Fact VerificationTabFact Small official (test)
Verification Accuracy92.1
10
Showing 25 of 38 rows