Latent Bridges for Multi-Table Question Answering
About
We introduce GRAB, a constructor-encoder-bridge pipeline for table question answering. Our method lifts relational data into an heterogeneous graph, encodes it via message passing, and transfers the signals to an LLM through a small set of query-conditioned latent tokens. This provides the LLM with a compact, task-relevant structural representation together with the flattened text. Crucially, the LLM remains strictly frozen to preserve its general reasoning capabilities; we train only the lightweight graph encoder and latent bridge (91M parameters), allowing the entire pipeline to be trained efficiently. Our pipeline significantly improves performance on relational Question Answering, with the largest gains in demanding multi-table settings, offering an efficient, principled way to connect relational deep learning with LLMs.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Table Question Answering | HiTab | Accuracy76.83 | 129 | |
| Table Question Answering | WTQ | Accuracy58.75 | 109 | |
| Fact Verification | TabFact | Accuracy84.25 | 86 | |
| Table Question Answering | WikiSQL | Accuracy90.23 | 55 | |
| Text-to-SQL | Spider | Execution Accuracy (EX)72.46 | 38 | |
| Question Answering | TabMWP | Accuracy87.78 | 26 | |
| Table Question Answering | TQA-Bench | Accuracy91.29 | 15 | |
| Single-table question answering | StructQA | Accuracy86 | 8 | |
| Single-table question answering | HCTQA | F1 Score87.93 | 8 | |
| Multi-table Question Answering | MMQA | List EM31.1 | 7 |