DEL-ToM: Inference-Time Scaling for Theory-of-Mind Reasoning via Dynamic Epistemic Logic
Yuheng Wu, Jianwen Xie, Denghui Zhang, Zhaozhuo Xu
Abstract
Theory-of-Mind (ToM) tasks pose a unique challenge for large language models (LLMs), which often lack the capability for dynamic logical reasoning. In this work, we propose DEL-ToM, a framework that improves verifiable ToM reasoning through inference-time scaling rather than architectural changes. Our approach decomposes ToM tasks into a sequence of belief updates grounded in Dynamic Epistemic Logic (DEL), enabling structured and verifiable dynamic logical reasoning. We use data generated automatically via a DEL simulator to train a verifier, which we call the Process Belief Model (PBM), to score each belief update step. During inference, the PBM evaluates candidate belief traces from the LLM and selects the highest-scoring one. This allows LLMs to allocate extra inference-time compute to yield more transparent reasoning. Experiments across model scales and benchmarks show that DEL-ToM consistently improves performance, demonstrating that verifiable belief supervision significantly enhances LLMs' ToM capabilities without retraining. Code is available at https://github.com/joel-wu/DEL-ToM . Let's try a few times, analyze belief at state 2! Belief Candidates LLM under Evaluation Drawer Table Null Fridge Mary thinks John thinks the chocolate is at... 0.99 0.41 0.62 0.01 Reward Score PBM Judge Drawer Belief Update State 1 Belief State Update State 2 State 3 State 4 Null 1 John, Mary and Alice entered the kitchen. State 1 2 John put the chocolate in the drawer. State 2 3 John exited the kitchen. State 3 4 Mary moved the chocolate to the table. State 4 Question: Where does Mary think John thinks the chocolate is?
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- Self-Consistency Improves Chain of Thought Reasoning in Language Models cites Language Models are Few-Shot Learners
- ReST-MCTS: LLM Self-Training via Process Reward Guided Tree Search cites Self-Consistency Improves Chain of Thought Reasoning in Language Models
- ReST-MCTS: LLM Self-Training via Process Reward Guided Tree Search cites Language Models are Few-Shot Learners
- Efficient Memory Management for Large Language Model Serving with PagedAttention cites Language Models are Few-Shot Learners
Builds on13
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
- Self-Consistency Improves Chain of Thought Reasoning in Language ModelsXuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le et al.ICLR 2023 · 681 citations
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchDan Zhang, Sining Zhoubian, Ziniu Hu, Yisong Yue et al.NeurIPS 2024 · 527 citations
- Reasoning with Exploration: An Entropy PerspectiveDaixuan Cheng, Shaohan Huang, Xuekai Zhu, Bo Dai et al.AAAI 2026 · 216 citations
Related papers
- TimeToM: Temporal Space is the Key to Unlocking the Door of Large Language Models' Theory-of-MindGuiyang Hou, Wenqi Zhang, Yongliang Shen, Linjuan Wu et al.ACL Findings 2024 · 6 citations
- MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal LogicDamien Sileo, Antoine LernouldEMNLP Findings 2023 · 10 citations
- AgentV-RL: Scaling Reward Modeling with Agentic VerifierJiazheng Zhang, Ziche Fu, Zhiheng Xi, Wenqing Jing et al.ACL Findings 2026
- Mind Your Theory: Theory of Mind Goes Deeper Than ReasoningEitan Wagner, Nitay Alon, Joseph M. Barnby, Omri AbendACL Findings 2025 · 1 citation
- AutoToM: Scaling Model-based Mental Inference via Automated Agent ModelingZhining Zhang, Chuanyang Jin, Mung Yao Jia, Shunchi Zhang et al.NeurIPS 2025 · 30 citations
