Adaptive Querying with AI Persona Priors
About
We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight query budgets. Classical Bayesian design and computerized adaptive testing typically rely on restrictive parametric assumptions or expensive posterior approximations, limiting their use in heterogeneous, high-dimensional, and cold-start settings. We introduce a persona-induced latent variable model that represents a user's state through membership in a finite dictionary of AI personas, each offering response distributions produced by a large language model. This yields expressive priors with closed-form posterior updates and efficient finite-mixture predictions, enabling scalable Bayesian design for sequential item selection. Experiments on synthetic data and WorldValuesBench demonstrate that persona-based posteriors deliver accurate probabilistic predictions and an interpretable adaptive elicitation pipeline.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Adaptive Querying | Synthetic users N = 20,000 (test) | Log Loss1.006 | 56 | |
| Ordinal Prediction | WorldValuesBench (held-out users) | Ordinal MSE0.54 | 56 | |
| Ordinal response prediction | Synthetic users N = 20,000 (test) | Ordinal MSE0.607 | 56 | |
| Response Prediction | WorldValuesBench (held-out) | Log Loss0.977 | 56 | |
| User response prediction | WorldValuesBench (held-out users) | Brier Score0.1347 | 56 | |
| Computerized Adaptive Testing | WorldValuesBench (test) | Inference Time (min)0.46 | 9 |