Adaptive Querying with AI Persona Priors
Kaizheng Wang, Yuhang Wu, Assaf Zeevi
Abstract
We study adaptive querying for learning user-dependent quantities of interest, such as responses to held-out items and psychometric indicators, within tight question budgets. Classical Bayesian design and computerized adaptive testing typically rely on restrictive parametric assumptions or expensive posterior approximations, limiting their use in heterogeneous, high-dimensional, and cold-start settings. We introduce a persona-induced latent variable model that represents a user's state through membership in a finite dictionary of AI personas, each offering response distributions produced by a large language model. This yields expressive priors with closed-form posterior updates and efficient finite-mixture predictions, enabling scalable Bayesian design for sequential item selection. Experiments on synthetic data and WorldValuesBench demonstrate that persona-based posteriors deliver accurate probabilistic predictions and an interpretable adaptive elicitation pipeline.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Whose Opinions Do Language Models Reflect?Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee et al.ICML 2023 · 764 citations
- Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject StudiesGati V. Aher, Rosa I. Arriaga, Adam Tauman KalaiICML 2023 · 651 citations
- Evaluating the Moral Beliefs Encoded in LLMsNino Scherrer, Claudia Shi, Amir Feder, David M. BleiNeurIPS 2023 · 316 citations
- Deep Adaptive Design: Amortizing Sequential Bayesian Experimental DesignAdam Foster, Desi R. Ivanova, Ilyas Malik, Tom RainforthICML 2021 · 119 citations
- Bayesian Experimental Design for Implicit Models by Mutual Information Neural EstimationSteven Kleinegesse, Michael U. GutmannICML 2020 · 84 citations
Related papers
- PersonalLLM: Tailoring LLMs to Individual PreferencesThomas P. Zollo, Andrew Wei Tung Siah, Naimeng Ye, Ang Li et al.ICLR 2025
- Whom to Query for What: Adaptive Group Elicitation via Multi-Turn LLM InteractionsRuomeng Ding, Tianwei Gao, Tom Zollo, Eitan Bachmat et al.ICML 2026
- Cold-Start Personalization via Bayesian Adaptive QuestioningAvinandan Bose, Stella Li, Faeze Brahman, Pang Wei Koh et al.ICML 2026
- PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context LearningHyeong Kyu Choi, Yixuan LiICML 2024 · 31 citations
- Adaptive Elicitation of Latent Information Using Natural LanguageJimmy Wang, Thomas P. Zollo, Richard S. Zemel, Hongseok NamkoongICML 2025
