SocAoG: Incremental Graph Parsing for Social Relation Inference in Dialogues
Liang Qiu, Yuan Liang, Yizhou Zhao, Pan Lu, Baolin Peng, Zhou Yu, Ying Nian Wu, Song-Chun Zhu
Abstract
Inferring social relations from dialogues is vital for building emotionally intelligent robots to interpret human language better and act accordingly. We model the social network as an And-or Graph, named SocAoG, for the consistency of relations among a group and leveraging attributes as inference cues. Moreover, we formulate a sequential structure prediction task, and propose an α-β-γ strategy to incrementally parse SocAoG for the dynamic inference upon any incoming utterance: (i) an α process predicting attributes and relations conditioned on the semantics of dialogues, (ii) a β process updating the social relations based on related attributes, and (iii) a γ process updating individual's attributes based on interpersonal social relations. Empirical results on Di-alogRE and MovieGraph show that our model infers social relations more accurately than the state-of-the-art methods. Moreover, the ablation study shows the three processes complement each other, and the case study demonstrates the dynamic relational inference.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 588c08e0-73a3-4e3e-8182-ef99e8192a78Cited by top-tier papers3
- ValueNet: A New Dataset for Human Value Driven Dialogue SystemLiang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu et al.AAAI 2022 · 51 citations
- SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout GraphYuxing Long, Binyuan Hui, Fulong Ye, Yanyang Li et al.AAAI 2023 · 11 citations
- Value-Spectrum: Quantifying Preferences of Vision-Language Models via Value Decomposition in Social Media ContextsJingxuan Li, Yuning Yang, Shengqi Yang, Linfan Zhang et al.ACL 2025
Builds on4
- Few-shot Relation Extraction via Bayesian Meta-learning on Relation GraphsMeng Qu, Tianyu Gao, Louis-Pascal A. C. Xhonneux, Jian TangICML 2020 · 131 citations
- GDPNet: Refining Latent Multi-View Graph for Relation ExtractionFuzhao Xue, Aixin Sun, Hao Zhang, Eng Siong ChngAAAI 2021 · 90 citations
- Structured Attention for Unsupervised Dialogue Structure InductionLiang Qiu, Yizhou Zhao, Weiyan Shi, Yuan Liang et al.EMNLP 2020 · 29 citations
- Learning Interactions and Relationships Between Movie CharactersAnna Kukleva, Makarand Tapaswi, Ivan LaptevCVPR 2020
Related papers
- Linking the Characters: Video-oriented Social Graph Generation via Hierarchical-cumulative GCNShiwei Wu, Joya Chen, Tong Xu, Liyi Chen et al.ACM MM 2021 · 26 citations
- Progressive Relation Learning for Group Activity RecognitionGuyue Hu, Bo Cui, Yuan He, Shan YuCVPR 2020
- Iterative Context-Aware Graph Inference for Visual DialogDan Guo, Hui Wang, Hanwang Zhang, Zheng-Jun Zha et al.CVPR 2020
- A Graph Reasoning Network for Multi-turn Response Selection via Customized Pre-trainingYongkang Liu, Shi Feng, Daling Wang, Kaisong Song et al.AAAI 2021 · 23 citations
- Object-Relation Reasoning Graph for Action RecognitionYangjun Ou, Li Mi, Zhenzhong ChenCVPR 2022 · 25 citations
