A tale from the trenches: cognitive biases and software development
Souti Chattopadhyay, Nicholas Nelson, Audrey Au, Natalia Morales, Christopher A. Sanchez, Rahul Pandita, Anita Sarma
Abstract
Cognitive biases are hard-wired behaviors that influence developer actions and can set them on an incorrect course of action, necessitating backtracking. While researchers have found that cognitive biases occur in development tasks in controlled lab studies, we still don't know how these biases affect developers' everyday behavior. Without such an understanding, development tools and practices remain inadequate. To close this gap, we conducted a 2-part field study to examine the extent to which cognitive biases occur, the consequences of these biases on developer behavior, and the practices and tools that developers use to deal with these biases. About 70% of observed actions that were reversed were associated with at least one cognitive bias. Further, even though developers recognized that biases frequently occur, they routinely are forced to deal with such issues with ad hoc processes and sub-optimal tool support. As one participant (IP12) lamented: There is no salvation! CCS CONCEPTS • Human-centered computing → Field studies; Empirical studies in collaborative and social computing; • Applied computing → Psychology.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Matcha: An IDE Plugin for Creating Accurate Privacy Nutrition LabelsTianshi Li, Lorrie Faith Cranor, Yuvraj Agarwal, Jason I. HongUbiComp 2024 · 17 citations
- First come first served: the impact of file position on code reviewEnrico Fregnan, Larissa Braz, Marco D'Ambros, Gül Çalikli et al.FSE 2022 · 16 citations
- From Perception to Protection: A Developer-Centered Study of Security and Privacy Threats in Extended Reality (XR)Kunlin Cai, Jinghuai Zhang, Ying Li, Zhiyuan Wang et al.NDSS 2026
- Mitigating Prompt-Induced Cognitive Biases in General-Purpose AI for Software EngineeringFrancesco Sovrano, Gabriele Dominici, Alberto BacchelliFSE 2026
- Cognitive Biases in LLM-Assisted Software DevelopmentXinyi Zhou, Zeinadsadat Saghi, Sadra Sabouri, Rahul Pandita et al.ICSE 2026
Related papers
- How Do HCI Researchers Study Cognitive Biases? A Scoping ReviewNattapat Boonprakong, Benjamin Tag, Jorge Gonçalves, Tilman DinglerCHI 2025 · 19 citations
- Capturing Failures of Large Language Models via Human Cognitive BiasesErik Jones, Jacob SteinhardtNeurIPS 2022 · 154 citations
- Estimating cognitive biases with attention-aware inverse planningSounak Banerjee, Daphne Cornelisse, Deepak E. Gopinath, Emily Sumner et al.NeurIPS 2025 · 2 citations
- Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-makingCharvi Rastogi, Yunfeng Zhang, Dennis Wei, Kush R. Varshney et al.CSCW 2022 · 184 citations
- Code Today, Deadline Tomorrow: Procrastination Among Software DevelopersZeinabsadat Saghi, Thomas Zimmermann, Souti ChattopadhyayICSE 2025 · 1 citation
