FeTaQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Table-to-Text Generation | FeTaQA | Accuracy76.9 | 24 | |
| Table Retrieval | FetaQA | R@140.1 | 19 | |
| Free-form QA | FetaQA | BLEU40.5 | 16 | |
| Table Retrieval | FetaQA original (test) | Recall@1078.4 | 12 | |
| Table Question Answering | FeTaQA | S-BLEU40.5 | 12 | |
| Question Answering | FeTaQA | BLEU39.05 | 11 | |
| Query-focused table summarization | FeTaQA (test) | BLEU33.8 | 10 | |
| Question Answering | FeTaQA | ROUGE-L50.4 | 10 | |
| Table Question Answering | FeTaQA (test) | sacreBLEU19.32 | 8 | |
| Table Question Answering | FeTaQA (Evaluation Set) | Vanilla Performance48 | 8 | |
| Table Question Answering | FeTaQA (train) | Vanilla Score50 | 8 | |
| Free-form Table Question Answering | FeTaQA (test) | BLEU0.3261 | 8 | |
| Long-form Question Answering | FetaQA (test) | BLEU32.61 | 7 | |
| Cell-Level Attribution | FetaQA | Precision0.8981 | 6 | |
| Column-Level Attribution | FetaQA | Precision (%)96.39 | 6 | |
| Row-Level Attribution | FetaQA | Precision94.3 | 6 | |
| Cell-level attribution | FetaQA (gold set) | Precision0.6373 | 6 | |
| Free-form Table Question Answering | FeTaQA (100 randomly chosen samples) | Fluency0.98 | 6 | |
| Table-based Question Answering | FeTaQA 13 (test) | S-BLEU62.7 | 4 | |
| Table Question Answering | FeTaQA (sample (100 samples)) | Precision45 | 4 | |
| Table-to-Text Generation | FeTaQA | BLEU0.3344 | 4 |
Showing 21 of 21 rows