HiTab
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Table Question Answering | HiTab | Accuracy94.1 | 129 | |
| Table Question Answering | HiTab | F1 Score84.41 | 50 | |
| Tabular Question Answering | HiTab (val) | Validation Reward (mean@4)69.83 | 32 | |
| Table Question Answering | HiTab | Accuracy64.71 | 30 | |
| Question Answering | HiTab (held-in) | Accuracy58.2 | 21 | |
| Hierarchical Table Question Answering | HiTab | Accuracy87.24 | 19 | |
| Table Reasoning | HiTab | Accuracy80.17 | 18 | |
| Table Reasoning | HiTab | Pass@170.1 | 16 | |
| Hierarchical Table Question Answering | HiTab (test) | Accuracy (%)76.08 | 15 | |
| Question Answering | HiTab (test) | Accuracy63 | 11 | |
| Text Generation | HiTab T2T | BLEU16.96 | 11 | |
| Question Answering | HiTab | Accuracy70.5 | 10 | |
| Table Question Answering | HiTab (test) | Exact Match64 | 8 | |
| General Tabular Reasoning | HiTab (test) | Accuracy79.1 | 6 | |
| Table Question Answering | HiTab Subset (test) | EM68.37 | 6 | |
| Table-to-text generation | HiTab (test) | BLEU16.3 | 6 | |
| Table Question Answering | HiTab (test) | Execution Accuracy47 | 5 | |
| Table Question Answering | HiTab (dev) | Execution Accuracy48.8 | 5 | |
| Table Question Answering | HiTab (dev) | Accuracy63.51 | 4 | |
| Tabular Question Answering | HiTab | pass@167.1 | 3 | |
| Tabular Question Answering | HiTab | Question Answering Latency (s)6.19 | 3 | |
| Table structure recognition | HiTab I (held-in) | TEDS Score54 | 3 |
Showing 22 of 22 rows