Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Alignment-Guided Largest Table Overlap Size Estimation

About

Fast estimation of the size of the largest overlap between tables enables blocking and query-by-table retrieval in large table repositories. The first and the state-of-the-art estimator Armadillo improves efficiency by embedding each table independently and approximating overlap ratio via embedding similarity. However, accurate estimation in heterogeneous repositories remains limited by three challenges: (C1) overlap depends on row-column structure, i.e., each matched cell must preserve both its row and column membership under a joint alignment of the two tables, but existing encodings leave this structure to be inferred indirectly; (C2) independent encoding provides no explicit channel for inter-table alignment signals, biasing prediction toward global similarity; (C3) naive value encodings overfit to corpus-specific distributions, causing cross-domain degradation. Hence, we propose ALORE, a scalable and domain-robust overlap ratio estimator built on three principles: (P1) explicitly represent row-column structure; (P2) expose inter-table alignment signals during training without expensive alignment search; (P3) reduce sensitivity to corpus-specific value distributions. ALORE instantiates these principles with a Two-View Row-Column Hypergraph encoder, alignment-guided objectives with inexpensive interaction signals, and a domain-robust value mapping. Experiments on multiple datasets spanning diverse domains and scales, including a large real-world corpus beyond prior benchmarks, show that ALORE outperforms the state of the art. ALORE reduces MAE by up to 55% overall and 69% in zero-shot transfer, while achieving up to 89x speedup. We further validate its effectiveness for query-by-table retrieval.

Ge Lee, Shixun Huang, Zhifeng Bao, Shazia Sadiq, Yanchang Zhao• 2026

Related benchmarks

TaskDatasetResultRank
Table overlap ratio estimationRealEstate (test)
MAE0.144
18
Efficiency AnalysisWiki
Inference Latency0.07
14
Efficiency AnalysisGit
Infer Latency0.06
13
Efficiency AnalysisRealEstate
Inference Time0.11
13
Overlap ratio estimationWiki (held-out pairs)
MAE0.04
13
Overlap ratio estimationGit (held-out pairs)
MAE0.03
12
Query-by-Table RetrievalGit-Query (test)
nDCG@10.881
12
Query-by-Table RetrievalTP-TR (small)
nDCG@179.2
12
Table overlap ratio estimationWiki (test)
MAE0.208
9
Table overlap ratio estimationGit (test)
MAE0.154
9
Showing 10 of 10 rows

Other info

Follow for update