Computer Science Achievement and Writing Skills Predict Vibe Coding Proficiency
Sverrir Thorgeirsson, Theo B. Weidmann, Zhendong Su
摘要
Many software development platforms now support LLM-driven programming, or “vibe coding”, a technique that allows one to specify programs in natural language and iterate from observed behavior, all without directly editing source code. While its adoption is accelerating, little is known about which skills best predict success in this workflow. We report a preregistered cross-sectional study with tertiary-level students (N = 100) who completed measures of computer-science achievement, domain-general cognitive skills, written-communication proficiency, and a vibe-coding assessment. Tasks were curated via an eight-expert consensus process and executed in a purpose-built, vibe-coding environment that mirrors commercial tools while enabling controlled evaluation. We find that both writing skill and CS achievement are significant predictors of vibe-coding performance, and that CS achievement remains a significant predictor after controlling for domain-general cognitive skills. The results may inform tool and curriculum design, including when to emphasize prompt-writing versus CS fundamentals to support future software creators.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM PromptsJ. D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, Qian YangCHI 2023 · 被引用 892 次
- AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model PromptsTongshuang Wu, Michael Terry, Carrie Jun CaiCHI 2022 · 被引用 465 次
- Grounded Copilot: How Programmers Interact with Code-Generating ModelsShraddha Barke, Michael B. James, Nadia PolikarpovaOOPSLA 2023 · 被引用 408 次
- Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingMajeed Kazemitabaar, Justin Chow, Carl Ka To Ma, Barbara J. Ericson 等CHI 2023 · 被引用 348 次
- ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis TestingIan Arawjo, Chelse Swoopes, Priyan Vaithilingam, Martin Wattenberg 等CHI 2024 · 被引用 141 次
相关 Paper
- Building Software by Rolling the Dice: A Qualitative Study of Vibe CodingYi-Hung Chou, Boyuan Jiang, Yi Wen Chen, Mingyue Weng 等FSE 2026 · 被引用 1 次
- Exploring the Impacts and Challenges of Vibe Coding Paradigm to Children's Programming Learning and PracticesJanice Jianing Si, Donglin Li, Qiuning Wang, Alicia Wanyi Liu 等CHI 2026 · 被引用 3 次
- From Specifications to Implementation in the Gen-AI Era: Lessons from a Project-Based Software Engineering CourseYingying Wang, Masih Beigi Rizi, Fatemeh Khashei, Julia RubinFSE 2026
- SWE-IF: Aligning Code Evaluation with Human PreferenceMing Zhong, Xiang Zhou, Ting-Yun Chang, Qingze Wang 等ICML 2026 · 被引用 3 次
- Vibe Coding Entanglements - Repositioning Boundaries of Intention, Authorship, and Responsibility in Programming with Generative AIJakob Tholander, Martin JonssonCHI 2026 · 被引用 3 次
