Not All Inconsistency Is Equal: Decomposing LVLM Uncertainty into Belief Divergence and Belief Conflict
Jie Shi, Xiaodong Yue, Wei Liu, Yufei Chen, Feifan Dong
Abstract
Uncertainty Quantification (UQ) is critical for detecting hallucinations in black-box Large Vision-Language Models (LVLMs). However, prevailing methods like Discrete Semantic Entropy (DSE) are unreliable, as their scores are primarily dominated by the number of semantic clusters. This renders them incapable of distinguishing between benign semantic ambiguity (varied but coherent responses) and severe belief conflict (contradictory responses). We address this limitation by proposing a novel framework rooted in Dempster-Shafer theory of evidence, built on the premise that not all inconsistency is equal. Our method decomposes uncertainty into two complementary metrics: Belief Divergence, which quantifies ambiguity by measuring the separation between viewpoints, and Belief Conflict, which captures direct logical contradictions. Extensive experiments demonstrate that our framework provides a more reliable measure of uncertainty.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b9d679b0-1ae1-4036-9c43-41afc1a914b6Cited by top-tier papers2
- Mind the Gap: Catching Hallucinations via Evidence Drop on the Reasoning ManifoldQunJie Chen, Yufei Chen, Xiaodong Yue, Linye LiICML 2026
- Beyond Magnitude: Scale-Invariant Evidential Fusion for Multi-View ClassificationWei Liu, Yufei Chen, Jie Shi, Xiaodong YueICML 2026
Builds on13
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- Grounding Multimodal Large Language Models to the WorldZhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao et al.ICLR 2024 · 1,170 citations
- Reliable Conflictive Multi-View LearningCai Xu, Jiajun Si, Ziyu Guan, Wei Zhao et al.AAAI 2024 · 121 citations
- Trusted Multi-View Deep Learning with Opinion AggregationWei Liu, Xiaodong Yue, Yufei Chen, Thierry DenoeuxAAAI 2022 · 81 citations
- Safe Multi-View Deep ClassificationWei Liu, Yufei Chen, Xiaodong Yue, Changqing Zhang et al.AAAI 2023 · 27 citations
Related papers
- Detecting Misbehaviors of Large Vision-Language Models by Evidential Uncertainty QuantificationTao Huang, Rui Wang, Xiaofei Liu, Yi Qin et al.ICLR 2026 · 4 citations
- Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic SimilaritiesAlexander Nikitin, Jannik Kossen, Yarin Gal, Pekka MarttinenNeurIPS 2024 · 197 citations
- Semantic Volume: Quantifying and Detecting Both External and Internal Uncertainty in LLMsXiaomin Li, Zhou Yu, Ziji Zhang, Yingying Zhuang et al.AAAI 2026 · 11 citations
- DOUBT: Decoupled Object-level Understanding and Bridging via vMF-based Trustworthiness for Hallucination Detection in MLLMsKaiqi Chen, Yang Qin, Changhao He, Xi Peng et al.ICML 2026
- Estimating Semantic Alphabet Size for LLM Uncertainty QuantificationLucas H. McCabe, Rimon Melamed, Tom Hartvigsen, H. Howie HuangICLR 2026 · 7 citations
