HInT: Hypergraph Infusion at the Structural Layers Improves Table Understanding
Wonjin Lee, Soomi Jeong, Kwang In Kim
摘要
Decoder-only large language models (LLMs) struggle with table reasoning because tables must be serialized, which can obscure row-and columnlevel structure. Prior graph and hypergraph approaches encode structure with an external encoder, but their gains are often inconsistent under autoregressive decoding. We analyze how tabular structure is represented inside decoder-only LLMs and find that row and column relations are concentrated in a small subset of layers and attention heads. Based on this observation, we propose HInT (Hypergraph Infusion for Table reasoning), which injects hypergraph-derived structural features directly into the layers where these relations are concentrated. HInT constructs a table hypergraph over cells and headers, applies lightweight message passing, and fuses the resulting structural features with token hidden states through gated fusion. Experiments across diverse table reasoning tasks show consistent improvements over text-only baselines and prior (hyper)graphbased methods. Our code is available at https: //github.com/MLV-group/HInT.git.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- TabFact: A Large-scale Dataset for Table-based Fact VerificationWenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang 等ICLR 2020 · 被引用 674 次
- TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, Sebastian RiedelACL 2020 · 被引用 417 次
- MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual DataYilun Zhao, Yunxiang Li, Chenying Li, Rui ZhangACL 2022 · 被引用 168 次
- TableFormer: Robust Transformer Modeling for Table-Text EncodingJingfeng Yang, Aditya Gupta, Shyam Upadhyay, Luheng He 等ACL 2022 · 被引用 145 次
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMsQingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu 等ICLR 2024 · 被引用 76 次
相关 Paper
- HyTrel: Hypergraph-enhanced Tabular Data Representation LearningPei Chen, Soumajyoti Sarkar, Leonard Lausen, Balasubramaniam Srinivasan 等NeurIPS 2023 · 被引用 66 次
- Table as a Modality for Large Language ModelsLiyao Li, Chao Ye, Wentao Ye, Yifei Sun 等NeurIPS 2025 · 被引用 5 次
- TabEmb: Joint Semantic-Structure Embedding for Table AnnotationEhsan Hoseinzade, Ke Wang, Anandharaju Durai RajuACL 2026
- 2D-TPE: Two-Dimensional Positional Encoding Enhances Table Understanding for Large Language ModelsJia-Nan Li, Jian Guan, Wei Wu, Zhengtao Yu 等WWW 2025 · 被引用 4 次
- Probing How Scalable Table Data Enhances General Long-Context ReasoningHuaibing Xie, Guoliang Zhao, Yang Liu, Shihan Dou 等ICML 2026
