Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Adaptive Querying with AI Persona Priors

About

We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets. Classical Bayesian design and computerized adaptive testing typically rely on restrictive parametric assumptions or expensive posterior approximations, limiting their use in heterogeneous, high-dimensional, and cold-start settings. We introduce a persona-induced latent variable model that represents a user's state through membership in a finite dictionary of AI personas, each offering response distributions produced by a large language model. This yields expressive priors with closed-form posterior updates and efficient finite-mixture predictions, enabling scalable Bayesian design for sequential item selection. Experiments on synthetic data and WorldValuesBench demonstrate that persona-based posteriors deliver accurate probabilistic predictions and an interpretable adaptive elicitation pipeline.

Kaizheng Wang, Yuhang Wu, Assaf Zeevi• 2026

Related benchmarks

TaskDatasetResultRank
Adaptive QueryingSynthetic users N = 20,000 (test)
Log Loss1.006
56
Ordinal PredictionWorldValuesBench (held-out users)
Ordinal MSE0.54
56
Ordinal response predictionSynthetic users N = 20,000 (test)
Ordinal MSE0.607
56
Response PredictionWorldValuesBench (held-out)
Log Loss0.977
56
User response predictionWorldValuesBench (held-out users)
Brier Score0.1347
56
Computerized Adaptive TestingWorldValuesBench (test)
Inference Time (min)0.46
9
Showing 6 of 6 rows

Other info

Follow for update