Bridging Instead of Replacing Online Coding Communities with AI through Community-Enriched Chatbot Designs CSCW008
Junling Wang, Lahari Goswami, Gustavo Kreia Umbelino, Kiara Chau, Mrinmaya Sachan, April Yi Wang
Abstract
LLM-based chatbots like ChatGPT have become popular tools for assisting with coding tasks. However, they often produce isolated responses and lack mechanisms for social learning or contextual grounding. In contrast, online coding communities like Kaggle offer socially mediated learning environments that foster critical thinking, engagement, and a sense of belonging. Yet, growing reliance on LLMs risks diminishing participation in these communities and weakening their collaborative value. To address this, we propose Community-Enriched AI, a design paradigm that embeds social learning dynamics into LLM-based chatbots by surfacing user-generated content and social design features from online coding communities. Using this paradigm, we implemented a RAG-based AI chatbot leveraging resources from Kaggle to validate our design. Across two empirical studies involving 28 and 12 data science learners, respectively, we found that Community-Enriched AI significantly enhances user trust, encourages engagement with community, and effectively supports learners in solving data science tasks. We conclude by discussing design implications for AI assistance systems that bridge-rather than replace-online coding communities.
CCS Concepts: • Human-centered computing → Empirical studies in HCI; Empirical studies in collaborative and social computing.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on21
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Expanding Explainability: Towards Social Transparency in AI systemsUpol Ehsan, Q. Vera Liao, Michael J. Muller, Mark O. Riedl et al.CHI 2021 · 505 citations
- CodeAid: Evaluating a Classroom Deployment of an LLM-based Programming Assistant that Balances Student and Educator NeedsMajeed Kazemitabaar, Runlong Ye, Xiaoning Wang, Austin Zachary Henley et al.CHI 2024 · 246 citations
- Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow QuestionsSamia Kabir, David N. Udo-Imeh, Bonan Kou, Tianyi ZhangCHI 2024 · 149 citations
- Contrastive Learning Reduces Hallucination in ConversationsWeiwei Sun, Zhengliang Shi, Shen Gao, Pengjie Ren et al.AAAI 2023 · 92 citations
Related papers
- 'Always Nice and Confident, Sometimes Wrong': Developer's Experiences Engaging Generative AI Chatbots Versus Human-Powered Q&A PlatformsJiachen Li, Elizabeth D. Mynatt, Varun Mishra, Jonathan BellCSCW 2025 · 8 citations
- Human-Human-AI Triadic Programming: Uncovering the Role of AI Agent and the Value of Human Partner in Collaborative LearningTaufiq Daryanto, Xiaohan Ding, Kaike Ping, Lance T. Wilhelm et al.CHI 2026 · 2 citations
- Rocks Coding, Not Development: A Human-Centric, Experimental Evaluation of LLM-Supported SE TasksWei Wang, Huilong Ning, Gaowei Zhang, Libo Liu et al.FSE 2024 · 17 citations
- Botender: Supporting Communities in Collaboratively Designing AI Agents through Case-Based ProvocationsTzu-Sheng Kuo, Sophia Liu, Quan Ze Chen, Joseph Seering et al.CHI 2026 · 1 citation
- 'There Has To Be a Lot That We're Missing': Moderating AI-Generated Content on RedditTravis Lloyd, Joseph Reagle, Mor NaamanCSCW 2025 · 6 citations
