Lune

EMNLP Findings2023

One-Model-Connects-All: A Unified Graph Pre-Training Model for Online Community Modeling

Ruoxue Ma, Jiarong Xu, Xinnong Zhang, Haozhe Zhang, Zuyu Zhao, Qi Zhang, Xuanjing Huang, Zhongyu Wei

Abstract

Online community is composed of communities, users, and user-generated textual content, with rich information that can help us solve social problems. Previous research hasn't fully utilized these three components and the relationship among them. What's more, they can't adapt to a wide range of downstream tasks. To solve these problems, we focus on a framework that simultaneously considers communities, users, and texts. And it can easily connect with a variety of downstream tasks related to social media. Specifically, we use a ternary heterogeneous graph to model online communities. Text reconstruction and edge generation are used to learn structural and semantic knowledge among communities, users, and texts. By leveraging this pre-trained model, we achieve promising results across multiple downstream tasks, such as violation detection, sentiment analysis, and community recommendation. Our exploration will improve online community modeling.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Can Modifying Data Address Graph Domain Adaptation? cites Measuring Task Similarity and Its Implication in Fine-Tuning Graph Neural Networks
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. Measuring Task Similarity and Its Implication in Fine-Tuning Graph Neural NetworksRenhong Huang, Jiarong Xu, Xin Jiang, Chenglu Pan et al.AAAI 2024 · 14 citations
  2. Can Modifying Data Address Graph Domain Adaptation?Renhong Huang, Jiarong Xu, Xin Jiang, Ruichuan An et al.KDD 2024 · 1 citation

Builds on5

  1. GPT-GNN: Generative Pre-Training of Graph Neural NetworksZiniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang et al.KDD 2020 · 438 citations
  2. Detecting Community Sensitive Norm Violations in Online ConversationsChan Young Park, Julia Mendelsohn, Karthik Radhakrishnan, Kinjal Jain et al.EMNLP Findings 2021 · 12 citations
  3. UPPAM: A Unified Pre-training Architecture for Political Actor Modeling based on LanguageXinyi Mou, Zhongyu Wei, Qi Zhang, Xuanjing HuangACL 2023 · 6 citations
  4. Suum Cuique: Studying Bias in Taboo Detection with a Community PerspectiveOsama Khalid, Jonathan Rusert, Padmini SrinivasanACL Findings 2022 · 2 citations
  5. Ruddit: Norms of Offensiveness for English Reddit CommentsRishav Hada, Sohi Sudhir, Pushkar Mishra, Helen Yannakoudakis et al.ACL 2021

Related papers

  1. Pretraining Language Models with Text-Attributed Heterogeneous GraphsTao Zou, Le Yu, Yifei Huang, Leilei Sun et al.EMNLP Findings 2023 · 11 citations
  2. A Variational Edge Partition Model for Supervised Graph Representation LearningYilin He, Chaojie Wang, Hao Zhang, Bo Chen et al.NeurIPS 2022 · 6 citations
  3. Pre-training Graph Transformer with Multimodal Side Information for RecommendationYong Liu, Susen Yang, Chenyi Lei, Guoxin Wang et al.ACM MM 2021 · 77 citations
  4. Linking the Characters: Video-oriented Social Graph Generation via Hierarchical-cumulative GCNShiwei Wu, Joya Chen, Tong Xu, Liyi Chen et al.ACM MM 2021 · 26 citations
  5. Unleashing the Power of Emojis in Texts via Self-supervised Graph Pre-TrainingZhou Zhang, Dongzeng Tan, Jiaan Wang, Yilong Chen et al.EMNLP 2024
Dusk over the sea between two cliffs drawn in fine vertical lines