Interactive Classification by Asking Informative Questions
Lili Yu, Howard Chen, Sida I. Wang, Tao Lei, Yoav Artzi
Abstract
We study the potential for interaction in natural language classification. We add a limited form of interaction for intent classification, where users provide an initial query using natural language, and the system asks for additional information using binary or multichoice questions. At each turn, our system decides between asking the most informative question or making the final classification prediction.The simplicity of the model allows for bootstrapping of the system without interaction data, instead relying on simple crowdsourcing tasks. We evaluate our approach on two domains, showing the benefit of interaction and the advantage of learning to balance between asking additional questions and making the final prediction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 36fd6fce-31a6-4fda-99e9-85bf40c67ed8Cited by top-tier papers6
- Generating Multi-turn Clarification for Web Information SeekingZiliang Zhao, Zhicheng DouWWW 2024 · 15 citations
- InteractComp: Evaluating Search Agents With Ambiguous QueriesMingyi Deng, Lijun Huang, Yani Fan, Fanqi Kong et al.ICML 2026 · 11 citations
- Shoot First, Ask Questions Later? Building Rational Agents that Explore and Act Like PeopleGabriel Grand, Valerio Pepe, Joshua B. Tenenbaum, Jacob AndreasICLR 2026 · 7 citations
- TRAVEL: Tag-Aware Conversational FAQ Retrieval via Reinforcement LearningYue Chen, Dingnan Jin, Chen Huang, Jia Liu et al.EMNLP 2023 · 1 citation
- Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying QuestionsMichael J. Q. Zhang, W. Bradley Knox, Eunsol ChoiICLR 2025
Related papers
- Efficient Algorithms for Crowd-Aided CategorizationYuanbing Li, Xian Wu, Yifei Jin, Jian Li et al.VLDB 2020 · 13 citations
- Ask and Retrieve Knowledge: Towards Proactive Asking with Imperfect Information in Medical Multi-turn DialoguesBolin Zhang, Shengwei Wang, Yangqin Jiang, Dianbo Sui et al.SIGIR 2025
- Interactive Concept Bottleneck ModelsKushal Chauhan, Rishabh Tiwari, Jan Freyberg, Pradeep Shenoy et al.AAAI 2023 · 91 citations
- Analyzing and Learning from User Interactions for Search ClarificationHamed Zamani, Bhaskar Mitra, Everest Chen, Gord Lueck et al.SIGIR 2020 · 84 citations
- Whom to Query for What: Adaptive Group Elicitation via Multi-Turn LLM InteractionsRuomeng Ding, Tianwei Gao, Tom Zollo, Eitan Bachmat et al.ICML 2026
