Computer Science Achievement and Writing Skills Predict Vibe Coding Proficiency
Sverrir Thorgeirsson, Theo B. Weidmann, Zhendong Su
Abstract
Many software development platforms now support LLM-driven programming, or “vibe coding”, a technique that allows one to specify programs in natural language and iterate from observed behavior, all without directly editing source code. While its adoption is accelerating, little is known about which skills best predict success in this workflow. We report a preregistered cross-sectional study with tertiary-level students (N = 100) who completed measures of computer-science achievement, domain-general cognitive skills, written-communication proficiency, and a vibe-coding assessment. Tasks were curated via an eight-expert consensus process and executed in a purpose-built, vibe-coding environment that mirrors commercial tools while enabling controlled evaluation. We find that both writing skill and CS achievement are significant predictors of vibe-coding performance, and that CS achievement remains a significant predictor after controlling for domain-general cognitive skills. The results may inform tool and curriculum design, including when to emphasize prompt-writing versus CS fundamentals to support future software creators.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d7a0d20d-a1d2-4136-bd6f-bf0fdc5e38ceBuilds on13
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 892 citations
- AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model PromptsTongshuang Wu, Michael Terry, Carrie Jun CaiCHI 2022 · 465 citations
- Grounded Copilot: How Programmers Interact with Code-Generating ModelsShraddha Barke, Michael B. James, Nadia PolikarpovaOOPSLA 2023 · 408 citations
- Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingMajeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J. Ericson et al.CHI 2023 · 348 citations
- ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis TestingIan Arawjo, Chelse Swoopes, Priyan Vaithilingam, Martin Wattenberg et al.CHI 2024 · 141 citations
Related papers
- Building Software by Rolling the Dice: A Qualitative Study of Vibe CodingYi-Hung Chou, Boyuan Jiang, Yi Wen Chen, Mingyue Weng et al.FSE 2026 · 1 citation
- Exploring the Impacts and Challenges of Vibe Coding Paradigm to Children's Programming Learning and PracticesJanice Jianing Si, Donglin Li, Qiuning Wang, Alicia Wanyi Liu et al.CHI 2026 · 3 citations
- From Specifications to Implementation in the Gen-AI Era: Lessons from a Project-Based Software Engineering CourseYingying Wang, Masih Beigi Rizi, Fatemeh Khashei, Julia RubinFSE 2026
- SWE-IF: Aligning Code Evaluation with Human PreferenceMing Zhong, Xiang Zhou, Ting-Yun Chang, Qingze Wang et al.ICML 2026 · 3 citations
- Vibe Coding Entanglements - Repositioning Boundaries of Intention, Authorship, and Responsibility in Programming with Generative AIJakob Tholander, Martin JonssonCHI 2026 · 3 citations
