Supporting High-Stakes Decision Making Through Interactive Preference Elicitation in the Latent Space
Michael Eichelbeck, Tim Voigt, Matthias Althoff
Abstract
High-stakes, infrequent consumer decisions, such as housing selection, challenge conventional recommender systems due to sparse interaction, heterogeneous multi-criteria objectives, and high-dimensional features. This work presents an interactive preference elicitation framework utilizing preferential Bayesian optimization (PBO) to learn the unknown utility function of a user from pairwise comparisons that are integrated in real-time. To increase efficiency in a complex feature space, we learn the preference model in the latent space of an autoencoder (AE). Additionally, to mitigate a cold start, we obtain a personalized probabilistic prior through an automated user interview with a large language model (LLM). We evaluate the developed method on rental real estate datasets from two major European cities. The results show that executing PBO in the AE latent space improves final pairwise ranking accuracy by 12%. For LLM-based preference prior generation, we find that direct, LLM-driven weight specification is outperformed by a static prior, while probabilistically weighted priors using LLMs achieve 25% better pairwise accuracy.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 73ce6d2e-b1a6-4ba6-a3b8-cc40e9810ae3Builds on5
- BoTorch: A Framework for Efficient Monte-Carlo Bayesian OptimizationMaximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton et al.NeurIPS 2020 · 686 citations
- Knowledge-aware Conversational Preference Elicitation with Bandit FeedbackCanzhe Zhao, Tong Yu, Zhihui Xie, Shuai LiWWW 2022 · 24 citations
- High-Dimensional Dueling Optimization with Preference EmbeddingYangwenhui Zhang, Hong Qian, Xiang Shu, Aimin ZhouAAAI 2023 · 4 citations
- DeLLMa: Decision Making Under Uncertainty with Large Language ModelsOllie Liu, Deqing Fu, Dani Yogatama, Willie NeiswangerICLR 2025
- Eliciting Human Preferences with Language ModelsBelinda Z. Li, Alex Tamkin, Noah D. Goodman, Jacob AndreasICLR 2025
Related papers
- PABBO: Preferential Amortized Black-Box OptimizationXinyu Zhang, Daolang Huang, Samuel Kaski, Julien MartinelliICLR 2025
- Multi-Objective Bayesian Optimization with Active Preference LearningRyota Ozaki, Kazuki Ishikawa, Youhei Kanzaki, Shion Takeno et al.AAAI 2024 · 18 citations
- LILO: Bayesian Optimization with Natural Language FeedbackKatarzyna Kobalczyk, Zhiyuan Lin, Benjamin Letham, Zhuokai Zhao et al.ICML 2026 · 2 citations
- Cold-Start Personalization via Bayesian Adaptive QuestioningAvinandan Bose, Stella Li, Faeze Brahman, Pang Wei Koh et al.ICML 2026
- Decisive: Guiding User Decisions with Optimal Preference Elicitation from Unstructured DocumentsAkriti Jain, Anish Mulay, Divyansh Verma, Aishani Pandey et al.ACL 2026
