An Unsupervised Joint System for Text Generation from Knowledge Graphs and Semantic Parsing
Martin Schmitt, Sahand Sharifzadeh, Volker Tresp, Hinrich Schütze
Abstract
Knowledge graphs (KGs) can vary greatly from one domain to another. Therefore supervised approaches to both graph-to-text generation and text-to-graph knowledge extraction (semantic parsing) will always suffer from a shortage of domain-specific parallel graphtext data; at the same time, adapting a model trained on a different domain is often impossible due to little or no overlap in entities and relations. This situation calls for an approach that (1) does not need large amounts of annotated data and thus (2) does not need to rely on domain adaptation techniques to work well in different domains. To this end, we present the first approach to unsupervised text generation from KGs and show simultaneously how it can be used for unsupervised semantic parsing. We evaluate our approach on WebNLG v2.1 and a new benchmark leveraging scene graphs from Visual Genome. Our system outperforms strong baselines for both text↔graph conversion tasks without any manual adaptation from one dataset to the other. In additional experiments, we investigate the impact of using different unsupervised objectives. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 26365a37-1b9c-420c-bd2b-eaf2dda68d35Cited by top-tier papers6
- Improving Scene Graph Classification by Exploiting Knowledge from TextsSahand Sharifzadeh, Sina Moayed Baharlou, Martin Schmitt, Hinrich Schütze et al.AAAI 2022 · 20 citations
- Graph Language ModelsMoritz Plenz, Anette FrankACL 2024
- Employing Argumentation Knowledge Graphs for Neural Argument GenerationKhalid Al Khatib, Lukas Trautner, Henning Wachsmuth, Yufang Hou et al.ACL 2021
- Latent Constraints on Unsupervised Text-Graph Alignment with Information AsymmetryJidong Tian, Wenqing Chen, Yitian Li, Caoyun Fan et al.AAAI 2023
- From Paraphrasing to Semantic Parsing: Unsupervised Semantic Parsing via Synchronous Semantic DecodingShan Wu, Bo Chen, Chunlei Xin, Xianpei Han et al.ACL 2021
Related papers
- Learning to Generate Language-Supervised and Open-Vocabulary Scene Graph Using Pre-Trained Visual-Semantic SpaceYong Zhang, Yingwei Pan, Ting Yao, Rui Huang et al.CVPR 2023
- TextPSG: Panoptic Scene Graph Generation from Textual DescriptionsChengyang Zhao, Yikang Shen, Zhenfang Chen, Mingyu Ding et al.ICCV 2023 · 24 citations
- Unpaired Image Captioning via Scene Graph AlignmentsJiuxiang Gu, Shafiq R. Joty, Jianfei Cai, Handong Zhao et al.ICCV 2019 · 191 citations
- Unsupervised Graph-Text Mutual Conversion with a Unified Pretrained Language ModelYi Xu, Shuqian Sheng, Jiexing Qi, Luoyi Fu et al.ACL 2023
- KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationWenhu Chen, Yu Su, Xifeng Yan, William Yang WangEMNLP 2020 · 115 citations
