ACL2026
Immediate Inference: The Missing Foundation in Large Language Model Logical Reasoning
Sihang Jiang, Zhiyu Lu, Keyi Wang, Jiaqing Liang, Yanghua Xiao, Xiaojun Meng, Jiansheng Wei
摘要
While extensive research has evaluated LLMs on complex reasoning tasks, the foundational building blocks of logical reasoning remain un-derexplored. We introduce IIBench , a benchmark evaluating immediate inference (elementary operations over categorical propositions). Our evaluation reveals that even SoTA models exhibit systematic deficiencies in immediate inference, and establishes immediate inference as foundational: it mediates approximately 40% of the effect on syllogistic reasoning, with near-perfect correlation ( ρ = 0.98) across reasoning benchmarks. Our analysis reveals that models lack robust operator grounding, oscillating be-tween structural reasoning and surface pattern matching with inconsistent handling of quantifiers and negation. 1