Lune

EMNLP Findings2023

A Table-to-Text Framework with Heterogeneous Multidominance Attention and Self-Evaluated Multi-Pass Deliberation

Xi Chen, Xinjiang Lu, Haoran Xin, Wenjun Peng, Haoyang Duan, Feihu Jiang, Jingbo Zhou, Hui Xiong

Abstract

Though big progress in table-to-text works, effectively leveraging table structure signals, e.g., hierarchical structure, remains challenging. Besides, deliberating generated descriptions proves to be effective for table-to-text. However, determining the appropriate outcome when encountering multi-pass candidates is another challenge. To this end, we propose a novel table-to-text approach on top of Self-evaluated multi-pass Generation and Heterogenous Multidominance Attention, namely SG-HMA. Specifically, we formulate the table structure into a multidominance (MD) structure and devise a heterogenous multidominance attention (HMA) to comprehensively explore the complex interactions encoded in the hierarchical structure, which can further deliver rich signals for text generation with the help of pre-trained language models (PLMs). Afterward, a contrastive loss is introduced to align the generation objective with evaluation metrics, so the more faithful generated descriptions can be guaranteed. We conduct extensive experiments on three public datasets, demonstrating that SG-HMA outperforms several SOTA methods quantitatively and qualitatively.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

4 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Tackling Uncertain Correspondences for Multi-Modal Entity Alignment cites Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs
  • Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs cites Tackling Uncertain Correspondences for Multi-Modal Entity Alignment
  • BRIO: Bringing Order to Abstractive Summarization cites Extractive Summarization as Text Matching
  • BRIO: Bringing Order to Abstractive Summarization cites Sequence Level Contrastive Learning for Text Summarization
  • BRIO: Bringing Order to Abstractive Summarization cites CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization
  • Sequence Level Contrastive Learning for Text Summarization cites Extractive Summarization as Text Matching
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers4

  1. Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge GraphsLiyi Chen, Panrong Tong, Zhongming Jin, Ying Sun et al.NeurIPS 2024 · 160 citations
  2. Tackling Uncertain Correspondences for Multi-Modal Entity AlignmentLiyi Chen, Ying Sun, Shengzhe Zhang, Yuyang Ye et al.NeurIPS 2024 · 20 citations
  3. PixT3: Pixel-based Table-To-Text GenerationIñigo Alonso, Eneko Agirre, Mirella LapataACL 2024 · 2 citations
  4. Beyond the Known: An Unknown-Aware Large Language Model for Open-Set Text ClassificationXi Chen, Chuan Qin, Ziqi Wang, Shasha Hu et al.ICLR 2026

Builds on8

  1. Extractive Summarization as Text MatchingMing Zhong, Pengfei Liu, Yiran Chen, Danqing Wang et al.ACL 2020 · 410 citations
  2. A Contrastive Framework for Neural Text GenerationYixuan Su, Tian Lan, Yan Wang, Dani Yogatama et al.NeurIPS 2022 · 349 citations
  3. BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir R. Radev, Graham NeubigACL 2022 · 329 citations
  4. CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive SummarizationShuyang Cao, Lu WangEMNLP 2021 · 130 citations
  5. Sequence Level Contrastive Learning for Text SummarizationShusheng Xu, Xingxing Zhang, Yi Wu, Furu WeiAAAI 2022 · 113 citations

Related papers

  1. Towards Table-to-Text Generation with Pretrained Language Model: A Table Structure Understanding and Text Deliberating ApproachMiao Chen, Xinjiang Lu, Tong Xu, Yanyan Li et al.EMNLP 2022 · 10 citations
  2. QuASAR: A Question-Driven Structure-Aware Approach for Table-to-Text GenerationWeijie Liu, Yibin Zheng, Fang KongACL 2025
  3. HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table UnderstandingRihui Jin, Yu Li, Guilin Qi, Nan Hu et al.AAAI 2025 · 1 citation
  4. Structure-Aware Pre-Training for Table-to-Text GenerationXinyu Xing, Xiaojun WanACL Findings 2021 · 20 citations
  5. TableVLM: Multi-modal Pre-training for Table Structure RecognitionLeiyuan Chen, Chengsong Huang, Xiaoqing Zheng, Jinshu Lin et al.ACL 2023 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines