Inferring the Invisible: Neuro-Symbolic Rule Discovery for Missing Value Imputation
Wendi Ren, Ke Wan, Junyu Leng, Shuang Li
Abstract
One of the central challenges in artificial intelligence is reasoning under partial observability, where key values are missing but essential for understanding and modeling the system. This paper presents a neuro-symbolic framework for latent rule discovery and missing value imputation. In contrast to traditional latent variable models, our approach treats missing grounded values as latent predicates to be inferred through logical reasoning. By interleaving neural representation learning with symbolic rule induction, the model iteratively discovers—both conjunctive and disjunctive rules—that explain observed patterns and recover missing entries. Our framework seamlessly handles heterogeneous data, reasoning over both discrete and continuous features by learning soft predicates from continuous values. Crucially, the inferred values not only fill in gaps in the data but also serve as supporting evidence for further rule induction and inference—creating a feedback loop in which imputation and rule mining reinforce one another. Using a staged block-coordinate gradient descent, the system learns these rules end-to-end by iteratively optimizing over parameter blocks in an alternating fashion. Experiments on both synthetic and real-world datasets demonstrate that our method effectively imputes missing values while uncovering meaningful, human-interpretable rules that govern system dynamics.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2bb5d0e8-1e34-4e66-b4ca-9d2d947bc3a0Builds on7
- Entropy-Based Logic Explanations of Neural NetworksPietro Barbiero, Gabriele Ciravegna, Francesco Giannini, Pietro Lió et al.AAAI 2022 · 97 citations
- Scalable Rule-Based Representation Learning for Interpretable ClassificationZhuo Wang, Wei Zhang, Ning Liu, Jianyong WangNeurIPS 2021 · 87 citations
- Learning Accurate and Interpretable Decision Rule Sets from Neural NetworksLitao Qiao, Weijia Wang, Bill LinAAAI 2021 · 53 citations
- Differentiable Inductive Logic Programming for Structured ExamplesHikaru Shindo, Masaaki Nishino, Akihiro YamamotoAAAI 2021 · 40 citations
- Neuro-Symbolic Hierarchical Rule InductionClaire Glanois, Zhaohui Jiang, Xuening Feng, Paul Weng et al.ICML 2022 · 34 citations
Related papers
- What's a good imputation to predict with missing values?Marine Le Morvan, Julie Josse, Erwan Scornet, Gaël VaroquauxNeurIPS 2021 · 95 citations
- VAEL: Bridging Variational Autoencoders and Probabilistic Logic ProgrammingEleonora Misino, Giuseppe Marra, Emanuele SansoneNeurIPS 2022 · 38 citations
- Neuro-Symbolic Temporal Point ProcessesYang Yang, Chao Yang, Boyang Li, Yinghao Fu et al.ICML 2024 · 6 citations
- Logical Neural Networks for Knowledge Base Completion with Embeddings & RulesPrithviraj Sen, Breno W. S. R. de Carvalho, Ibrahim Abdelaziz, Pavan Kapanipathi et al.EMNLP 2022 · 2 citations
- Adaptive Data-Knowledge Alignment in Genetic Perturbation PredictionYuanfang Xiang, Lun AiICLR 2026
