Lune

ACM MM2020Top-tier venue

Multi-modal Attentive Graph Pooling Model for Community Question Answer Matching

Jun Hu, Quan Fang, Shengsheng Qian, Changsheng Xu

Abstract

Nowadays, millions of users use community question answering (CQA) systems to share valuable knowledge. An essential function of CQA systems is the accurate matching of answers w.r.t a given question. Recent research exhibits the superior advantages of graph neural networks (GNNs) on modeling content semantics for CQA matching. However, existing GNN-based approaches are insufficient to deal with the multi-modal and redundant properties of CQA systems. In this paper, we propose a multi-modal attentive graph pooling approach (MMAGP) to model the multi-modal content of questions and answers with GNNs in a unified framework, which explores the multi-modal and redundant properties of CQA systems. Our model converts each question/answer into a multi-modal content graph, which can preserve the relational information within multi-modal content. Specifically, to exploit the visual information, we propose an unsupervised meta-path link prediction approach to extract labels from visual content and model them into the multi-modal graph. An attentive graph pooling network is proposed to select vertices in the multi-modal content graph that are significant for the matching adaptively, and generate a pooled graph via aggregating context information for selected vertices. An interaction pooling network is designed to infer the final matching score based on the interactions between the pooled graphs of the input question and answer. Experimental results on two real-world datasets demonstrate the superior performance of MMAGP compared with other state-of-the-art CQA matching models.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

its abstract · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. General Debiasing for Multimodal Sentiment AnalysisTeng Sun, Juntong Ni, Wenjie Wang, Liqiang Jing et al.ACM MM 2023 · 31 citations

Related papers

  1. Relation-Aware Language-Graph Transformer for Question AnsweringJinyoung Park, Hyeong Kyu Choi, Juyeon Ko, Hyeon-Jin Park et al.AAAI 2023 · 16 citations
  2. Multimodal Neural Graph Memory Networks for Visual Question AnsweringMahmoud KhademiACL 2020 · 35 citations
  3. Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene TextDifei Gao, Ke Li, Ruiping Wang, Shiguang Shan et al.CVPR 2020
  4. Graph-Based Tri-Attention Network for Answer Ranking in CQAWei Zhang, Zeyuan Chen, Chao Dong, Wen Wang et al.AAAI 2021 · 18 citations
  5. DGQAN: Dual Graph Question-Answer Attention Networks for Answer SelectionHaitian Yang, Xuan Zhao, Yan Wang, Min Li et al.SIGIR 2022 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines