Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PIPER: Content-Based Table Search via profiling and LLM-Generated Pseudoqueries

About

The rapid growth of tabular datasets in data lakes, data spaces, and open data portals makes effective dataset search essential for reuse and analysis. Existing search systems rely mainly on metadata, which is often incomplete or low quality, especially for tables whose meaning depends on both schema and cell values. Recent advances in Large Language Models (LLMs) enable richer, content-based representations of tables. However, prior LLM-based retrieval methods have focused on Table Question Answering, where the goal is to select a single table to answer a question, rather than retrieve and rank relevant datasets. We propose PIPER, a content-driven retrieval method for tabular datasets that uses table profiles and LLM-generated queries embedded for dense retrieval. Designed for dataset search in poor-metadata settings, PIPER outperforms both classical metadata-based baselines and strong TableQA retrieval methods, demonstrating the value of LLM-based content modeling for tabular dataset search.

Riccardo Terrenzi, Matteo Falconi, Serkan Ayvaz, Pierluigi Plebani• 2026

Related benchmarks

TaskDatasetResultRank
Table RetrievalOTT-QA (test)
Recall@1078
27
Table RetrievalFeTaQA
R@140.1
19
Table RetrievalOTTQA
R@135.6
19
Table RetrievalFetaQA original (test)
Recall@1078.4
12
RetrievalNTCIR-15 Complex NL (test)
MAP56
7
RetrievalNTCIR-15 Keyword (test)
MAP48.3
7
Showing 6 of 6 rows

Other info

Follow for update