Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction
Yifan Song, Wenxuan Wendy Shi, Brian P. Bailey, Tal August
Abstract
Team roles offer an interpretable lens on collaboration, yet computational studies of roles often rely on domain-specific personas or data-driven clustering rather than theory-grounded taxonomies. We operationalize a taxonomy of eight communication roles grounded in education literature and annotate a corpus of 6,307 Slack messages from 55 students across 18 teams in a semester-long computer science course project. We evaluate whether LLMs can approximate expert labels, enabling scalable, taxonomy-driven role annotation. Using these role labels, we characterize role dynamics over teams'lifecycles, finding that different roles peak at different moments and that students enact a more diverse set of roles as projects progress. To evaluate the utility of our role constructs, we use them to predict peer recognition, outperforming lexical, conversational, and LLM-prompting baselines. To assess generalizability beyond the educational context, we apply the same role constructs to a public dataset (DeliData) to predict team performance improvement after deliberation, again exceeding prior performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4e42e49f-2160-4342-b216-acf5368f5724Builds on9
- My Team Will Go On: Differentiating High and Low Viability Teams through Team InteractionHancheng Cao, Vivian Yang, Victor Chen, Yu Jin Lee et al.CSCW 2020 · 37 citations
- Embedding Democratic Values into Social Media AIs via Societal Objective FunctionsChenyan Jia, Michelle S. Lam, Minh Chau Mai, Jeffrey T. Hancock et al.CSCW 2024 · 32 citations
- Writing Strategies for Science Communication: Data and Computational AnalysisTal August, Lauren Kim, Katharina Reinecke, Noah A. SmithEMNLP 2020 · 22 citations
- DeliData: A Dataset for Deliberation in Multi-party Problem SolvingGeorgi Karadzhov, Tom Stafford, Andreas VlachosCSCW 2023 · 16 citations
- Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-AlignmentKeming Lu, Bowen Yu, Chang Zhou, Jingren ZhouACL 2024 · 16 citations
Related papers
- Evaluating Taxonomy Free Character Role Labeling (TF-CRL) in News Stories using Large Language ModelsDavid G. Hobson, Derek Ruths, Andrew PiperEMNLP 2025
- From Code Generation to Conceptual Learning: Student Use of LLMs in a Web Programming CourseHajara-Yasmin Isa, Matthew Weston, Muhammad Rizky Wellyanto, Ishita Karna et al.CHI 2026 · 1 citation
- Cracking the Case Together: Role Perceptions in Human-AI Mystery Solving DialoguesKarin Breckner, Johannes Schönböck, Carrie Kovacs, Frederik Hirschmann et al.CHI 2026 · 1 citation
- SeeSawBot: An LLM-Driven Chatbot Mediating Across Private and Shared Slack Channels to Support Team DynamicsYihe Wang, Kehua Lei, Sheng-Yang Chiu, Katherine Isbister et al.CHI 2026 · 1 citation
- Group Chat Ecology in Enterprise Instant Messaging: How Employees Collaborate Through Multi-User Chat Channels on SlackDakuo Wang, Haoyu Wang, Mo Yu, Zahra Ashktorab et al.CSCW 2022 · 29 citations
