How Do Developers Interact with AI? An Exploratory Study on Modeling Developer Programming Behavior
Yinan Wu, Ze Shi Li, Kathryn Thomasset Stolee, Bowen Xu
摘要
Artificial Intelligence (AI) is reshaping how developers adopt software engineering practices, yet the multi-dimensional nature of developer-AI interaction remains under-explored. Prior studies have primarily examined dimensions observable from developer activities such as “Prompt Crafting” and “Code Editing,” overlooking how hidden intentions and emotional dimensions intertwine with concrete actions during AI-assisted programming. Understanding the interplay is essential for improving developer experience and future AI assistant designs. To understand this phenomenon, we conducted a mixed-methods study with 76 developers. We first split developers into AI-assisted and non-AI groups. Each developer performed a programming task (either Python with API management or Java with SQL). Developers retrospectively labeled their self-reported intentions, tool-supported actions, and emotions (on a 7-point valence scale) from screen recordings, supplemented by participant surveys and interviews. Our user study resulted in a novel model, named S-IASE, with four dimensions to describe programming behavior for a given development state: intention, action, supporting tool, and emotion. Our analysis reveals several aggregated and sequential behavioral patterns. For example, for aggregated patterns, using AI assistants often led developers to focus more on actively “creating” code, evaluating, and verifying the generated results; for sequential patterns, AI-assisted participants showed emotionally stable development flows, as opposed to non-AI-assisted participants who experienced more fluctuating emotions. Interviews revealed further nuance: some developers reported impostor-like feelings, expressing guilt or self-doubt about relying on AI for programming. The uncovered patterns indicate that our model can provide actionable insights for improving AI assistants’ responsiveness, training developers in AI collaboration, and designing developer-centric AI studies. Our work bridges an important gap in understanding the complexities of developer-AI interaction in the programming context and sheds light on future developer-centric research directions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Grounded Copilot: How Programmers Interact with Code-Generating ModelsShraddha Barke, Michael B. James, Nadia PolikarpovaOOPSLA 2023 · 被引用 408 次
- Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingMajeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J. Ericson 等CHI 2023 · 被引用 348 次
- Using an LLM to Help With Code UnderstandingDaye Nam, Andrew Macvean, Vincent J. Hellendoorn, Bogdan Vasilescu 等ICSE 2024 · 被引用 264 次
- A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and ChallengesJenny T. Liang, Chenyang Yang, Brad A. MyersICSE 2024 · 被引用 126 次
- Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted ProgrammingHussein Mozannar, Gagan Bansal, Adam Fourney, Eric HorvitzCHI 2024 · 被引用 88 次
相关 Paper
- Evolving with AI: A Longitudinal Analysis of Developer LogsAgnia Sergeyuk, Eric Huang, Dariia Karaeva, Anastasiia Serova 等ICSE 2026
- Code with Me or for Me? How Increasing AI Automation Transforms Developer WorkflowsValerie Chen, Ameet Talwalkar, Robert Brennan, Graham NeubigCHI 2026 · 被引用 2 次
- Need Help? Designing Proactive AI Assistants for ProgrammingValerie Chen, Alan Zhu, Sebastian Zhao, Hussein Mozannar 等CHI 2025 · 被引用 23 次
- From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software EngineeringDana Feng, Bhada Yun, April Yi WangCHI 2026 · 被引用 2 次
- The Impact of Generative AI Coding Assistants on Developers Who Are Visually ImpairedClaudia Flores-Saviaga, Benjamin V. Hanrahan, Kashif Imteyaz, Steven Clarke 等CHI 2025 · 被引用 18 次
