Decoupling of Usefulness and Novelty: Evaluating the Impact of Generative AI on Design Outputs and Novice Designers' Creative Thinking
Yue Fu, Tony Zhou, Bin Han, Marx Wang, Yixin Chen, Zelia Gomes Da Costa Lai, Rock Yuren Pang, Katharina Reinecke, Jacob O. Wobbrock, Alexis Hiniker
Abstract
People are increasingly leveraging generative AI (GenAI) for design tasks, making it critical to understand GenAI’s impact on design outcomes and users’ creative capabilities. We conducted a within-subjects experiment where 36 participants designed advertisements both with and without GenAI. Evaluations from clients and online volunteers revealed that GenAI-supported designs were perceived as significantly more creative and unconventional. Additionally, online volunteers, but not clients, rated these designs as more visually appealing. However, neither group perceived differences in usefulness, and clients noted no improvement in brand alignment, highlighting a notable decoupling of novelty and usefulness (two established components of creativity) in GenAI-supported design outputs. Although short-term GenAI use did not broadly influence participants’ creative thinking or experience, subgroup analyses indicated increases in divergent thinking among participants new to GenAI relative to participants with GenAI experience. We discuss the implications of the decoupling effect and GenAI’s influence on humans’ creativity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- The Metacognitive Demands and Opportunities of Generative AILev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott et al.CHI 2024 · 279 citations
- The Effects of Generative AI on Design Fixation and Divergent ThinkingSamangi Wadinambiarachchi, Ryan M. Kelly, Saumya Pareek, Qiushi Zhou et al.CHI 2024 · 186 citations
- Does Writing with Language Models Reduce Content Diversity?Vishakh Padmakumar, He HeICLR 2024 · 173 citations
- User Experience Design Professionals' Perceptions of Generative Artificial IntelligenceJie Li, Hancheng Cao, Laura Lin, Youyang Hou et al.CHI 2024 · 149 citations
- FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion DesignYoungseung Jeon, Seungwan Jin, Patrick C. Shih, Kyungsik HanCHI 2021 · 143 citations
Related papers
- CreAItive Collaboration? Users' Misjudgment of AI-Creativity Affects Their Collaborative PerformanceMia Magdalena Bangerl, Leonie Disch, Tamara David, Viktoria Pammer-SchindlerCHI 2025 · 13 citations
- When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design TaskYuanning Han, Ziyi Qiu, Jiale Cheng, Ray LCCHI 2024 · 103 citations
- Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent ThinkingHarsh Kumar, Jonathan Vincentius, Ewan Jordan, Ashton AndersonCHI 2025 · 107 citations
- How the Role of Generative AI Shapes Perceptions of Value in Human-AI Collaborative WorkAaron Schecter, Benjamin RichardsonCHI 2025 · 6 citations
- Generative AI in Children's Creative Collaboration: Impact, Perception, and Design GuidelinesDaeun Yoo, Michele Newman, Caroline Pitt, Kevin Huu Vo et al.CHI 2026 · 1 citation
