UPPAM: A Unified Pre-training Architecture for Political Actor Modeling based on Language
Xinyi Mou, Zhongyu Wei, Qi Zhang, Xuanjing Huang
Abstract
Modeling political actors is at the core of quantitative political science. Existing works have incorporated contextual information to better learn the representation of political actors for specific tasks through graph models. However, they are limited to the structure and objective of training settings and can not be generalized to all politicians and other tasks. In this paper, we propose a Unified Pre-training Architecture for Political Actor Modeling based on language (UPPAM). In UPPAM, we aggregate statements to represent political actors and learn the mapping from languages to representation, instead of learning the representation of particular persons. We further design structureaware contrastive learning and behavior-driven contrastive learning tasks, to inject multidimensional information in the political context into the mapping. In this framework, we can profile political actors from different aspects and solve various downstream tasks. Experimental results demonstrate the effectiveness and capability of generalization of our method. * Corresponding author. • No church needs to provide contraception under ObamaCare. • Recovery package must provide state aid, hazard pay. • LGBT rights are in jeopardy from Supreme Court. • I oppose school busing because it fails, not for racism. languages social network behaviors Voted NO on defining unborn child as eligible for SCHIP. Voted NO on constitutional ban of same-sex marriage. Voted YES on Educational Savings Accounts.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6ec85822-9d25-407f-8df1-500951cce2eeCited by top-tier papers2
- Unifying Local and Global Knowledge: Empowering Large Language Models as Political Experts with Knowledge GraphsXinyi Mou, Zejun Li, Hanjia Lyu, Jiebo Luo et al.WWW 2024 · 20 citations
- Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language ModelsHao Li, Ruoyuan Gong, Hao JiangAAAI 2025 · 2 citations
Builds on10
- Weakly Supervised Learning of Nuanced Frames for Analyzing Polarization in News MediaShamik Roy, Dan GoldwasserEMNLP 2020 · 42 citations
- Text-Based Ideal PointsKeyon Vafa, Suresh Naidu, David M. BleiACL 2020 · 37 citations
- Understanding the Language of Political Agreement and Disagreement in Legislative TextsMaryam Davoodi, Eric Waltenburg, Dan GoldwasserACL 2020 · 15 citations
- PAR: Political Actor Representation Learning with Social Context and Expert KnowledgeShangbin Feng, Zhaoxuan Tan, Zilong Chen, Ningnan Wang et al.EMNLP 2022 · 7 citations
- Understanding Politics via Contextualized Discourse ProcessingRajkumar Pujari, Dan GoldwasserEMNLP 2021 · 6 citations
Related papers
- UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningWei Li, Can Gao, Guocheng Niu, Xinyan Xiao et al.ACL 2021
- CLEVE: Contrastive Pre-training for Event ExtractionZiqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin et al.ACL 2021
- UniCorn: A Unified Contrastive Learning Approach for Multi-view Molecular Representation LearningShikun Feng, Yuyan Ni, Minghao Li, Yanwen Huang et al.ICML 2024 · 22 citations
- Structured Video-Language Modeling with Temporal Grouping and Spatial GroundingYuanhao Xiong, Long Zhao, Boqing Gong, Ming-Hsuan Yang et al.ICLR 2024
- Sentiment-Aware Word and Sentence Level Pre-training for Sentiment AnalysisShuai Fan, Chen Lin, Haonan Li, Zhenghao Lin et al.EMNLP 2022 · 20 citations
