Alignment-Guided Largest Table Overlap Size Estimation
About
Fast estimation of the size of the largest overlap between tables enables blocking and query-by-table retrieval in large table repositories. The first and the state-of-the-art estimator Armadillo improves efficiency by embedding each table independently and approximating overlap ratio via embedding similarity. However, accurate estimation in heterogeneous repositories remains limited by three challenges: (C1) overlap depends on row-column structure, i.e., each matched cell must preserve both its row and column membership under a joint alignment of the two tables, but existing encodings leave this structure to be inferred indirectly; (C2) independent encoding provides no explicit channel for inter-table alignment signals, biasing prediction toward global similarity; (C3) naive value encodings overfit to corpus-specific distributions, causing cross-domain degradation. Hence, we propose ALORE, a scalable and domain-robust overlap ratio estimator built on three principles: (P1) explicitly represent row-column structure; (P2) expose inter-table alignment signals during training without expensive alignment search; (P3) reduce sensitivity to corpus-specific value distributions. ALORE instantiates these principles with a Two-View Row-Column Hypergraph encoder, alignment-guided objectives with inexpensive interaction signals, and a domain-robust value mapping. Experiments on multiple datasets spanning diverse domains and scales, including a large real-world corpus beyond prior benchmarks, show that ALORE outperforms the state of the art. ALORE reduces MAE by up to 55% overall and 69% in zero-shot transfer, while achieving up to 89x speedup. We further validate its effectiveness for query-by-table retrieval.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Table overlap ratio estimation | RealEstate (test) | MAE0.144 | 18 | |
| Efficiency Analysis | Wiki | Inference Latency0.07 | 14 | |
| Efficiency Analysis | Git | Infer Latency0.06 | 13 | |
| Efficiency Analysis | RealEstate | Inference Time0.11 | 13 | |
| Overlap ratio estimation | Wiki (held-out pairs) | MAE0.04 | 13 | |
| Overlap ratio estimation | Git (held-out pairs) | MAE0.03 | 12 | |
| Query-by-Table Retrieval | Git-Query (test) | nDCG@10.881 | 12 | |
| Query-by-Table Retrieval | TP-TR (small) | nDCG@179.2 | 12 | |
| Table overlap ratio estimation | Wiki (test) | MAE0.208 | 9 | |
| Table overlap ratio estimation | Git (test) | MAE0.154 | 9 |