HInT: Hypergraph Infusion at the Structural Layers Improves Table Understanding
Wonjin Lee, Soomi Jeong, Kwang In Kim
Abstract
Decoder-only large language models (LLMs) struggle with table reasoning because tables must be serialized, which can obscure row-and columnlevel structure. Prior graph and hypergraph approaches encode structure with an external encoder, but their gains are often inconsistent under autoregressive decoding. We analyze how tabular structure is represented inside decoder-only LLMs and find that row and column relations are concentrated in a small subset of layers and attention heads. Based on this observation, we propose HInT (Hypergraph Infusion for Table reasoning), which injects hypergraph-derived structural features directly into the layers where these relations are concentrated. HInT constructs a table hypergraph over cells and headers, applies lightweight message passing, and fuses the resulting structural features with token hidden states through gated fusion. Experiments across diverse table reasoning tasks show consistent improvements over text-only baselines and prior (hyper)graphbased methods. Our code is available at https: //github.com/MLV-group/HInT.git.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c4253b23-0401-4a41-adff-fee8803e6903Builds on17
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang et al.ICLR 2020 · 674 citations
- TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, Sebastian RiedelACL 2020 · 417 citations
- MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual DataYilun Zhao, Yunxiang Li, Chenying Li, Rui ZhangACL 2022 · 168 citations
- TableFormer: Robust Transformer Modeling for Table-Text EncodingJingfeng Yang, Aditya Gupta, Shyam Upadhyay, Luheng He et al.ACL 2022 · 145 citations
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMsQingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu et al.ICLR 2024 · 76 citations
Related papers
- HyTrel: Hypergraph-enhanced Tabular Data Representation LearningPei Chen, Soumajyoti Sarkar, Leonard Lausen, Balasubramaniam Srinivasan et al.NeurIPS 2023 · 66 citations
- Table as a Modality for Large Language ModelsLiyao Li, Chao Ye, Wentao Ye, Yifei Sun et al.NeurIPS 2025 · 5 citations
- TabEmb: Joint Semantic-Structure Embedding for Table AnnotationEhsan Hoseinzade, Ke Wang, Anandharaju Durai RajuACL 2026
- 2D-TPE: Two-Dimensional Positional Encoding Enhances Table Understanding for Large Language ModelsJia-Nan Li, Jian Guan, Wei Wu, Zhengtao Yu et al.WWW 2025 · 4 citations
- Probing How Scalable Table Data Enhances General Long-Context ReasoningHuaibing Xie, Guoliang Zhao, Yang Liu, Shihan Dou et al.ICML 2026
