ICML2026
HInT: Hypergraph Infusion at the Structural Layers Improves Table Understanding
Wonjin Lee, Soomi Jeong, Kwang In Kim
Abstract
Decoder-only large language models (LLMs) struggle with table reasoning because tables must be serialized, which can obscure row- and column-level structure. Prior graph and hypergraph approaches encode structure with an external encoder, but their gains are often inconsistent under autoregressive decoding. We analyze how tabular structure is represented inside decoder-only LLMs and find that row and column relations are concentrated in a small subset of layers and attention heads. Based on this observation, we propose HInT ( H ypergraph In fusion for T able reasoning), which injects hypergraph-derived structural features directly into the layers where these relations are concentrated. HInT constructs a table hypergraph over cells and headers, applies lightweight message passing, and fuses the resulting structural features with token hidden states through gated fusion. Experiments across diverse table reasoning tasks show consistent improvements over text-only baselines and prior (hyper)graph-based methods.