Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinking
Harsh Kumar, Jonathan Vincentius, Ewan Jordan, Ashton Anderson
Abstract
Large language models are transforming the creative process by offering unprecedented capabilities to algorithmically generate ideas. While these tools can enhance human creativity when people co-create with them, it's unclear how this will impact unassisted human creativity. We conducted two large pre-registered parallel experiments involving 1,100 participants attempting tasks targeting the two core components of creativity, divergent and convergent thinking. We compare the effects of two forms of large language model (LLM) assistance -- a standard LLM providing direct answers and a coach-like LLM offering guidance -- with a control group receiving no AI assistance, and focus particularly on how all groups perform in a final, unassisted stage. Our findings reveal that while LLM assistance can provide short-term boosts in creativity during assisted tasks, it may inadvertently hinder independent creative performance when users work without assistance, raising concerns about the long-term impact on human creativity and cognition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0ac860f1-aa96-4a6a-b910-98ec475c6868Cited by top-tier papers15
- To Rely or Not to Rely? Evaluating Interventions for Appropriate Reliance on Large Language ModelsJessica Y. Bo, Sophia Wan, Ashton AndersonCHI 2025 · 31 citations
- IdeaSynth: Iterative Research Idea Development Through Evolving and Composing Idea Facets with Literature-Grounded FeedbackKevin Pu, K. J. Kevin Feng, Tovi Grossman, Tom Hope et al.CHI 2025 · 15 citations
- Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving TasksJessica Y. Bo, Majeed Kazemitabaar, Mengqing Deng, Michael Inzlicht et al.CHI 2026 · 8 citations
- Partnering with Generative AI: Experimental Evaluation of Model-Led and Human-Led Interaction in Human-AI Co-CreationSebastian Maier, Manuel Schneider, Stefan FeuerriegelCHI 2026 · 5 citations
- Investigating the Effects of LLM Use on Critical Thinking Under Time Constraints: Access Timing and Time AvailabilityJiayin Zhi, Harsh Kumar, Mina LeeCHI 2026 · 5 citations
Builds on8
- CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model CapabilitiesMina Lee, Percy Liang, Qian YangCHI 2022 · 340 citations
- Does Writing with Language Models Reduce Content Diversity?Vishakh Padmakumar, He HeICLR 2024 · 173 citations
- Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language ModelsSangho Suh, Bryan Min, Srishti Palani, Haijun XiaUIST 2023 · 147 citations
- Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-CreationSangho Suh, Meng Chen, Bryan Min, Toby Jia-Jun Li et al.CHI 2024 · 143 citations
- Art or Artifice? Large Language Models and the False Promise of CreativityTuhin Chakrabarty, Philippe Laban, Divyansh Agarwal, Smaranda Muresan et al.CHI 2024 · 122 citations
Related papers
- Timing Matters: How Using LLMs at Different Timings Influences Writers' Perceptions and Ideation Outcomes in AI-Assisted IdeationPeinuan Qin, Chi-Lan Yang, Jingshu Li, Jing Wen et al.CHI 2025 · 19 citations
- AI-Augmented Brainwriting: Investigating the use of LLMs in group ideationOrit Shaer, Angelora Cooper, Osnat Mokryn, Andrew L. Kun et al.CHI 2024 · 120 citations
- CreAItive Collaboration? Users' Misjudgment of AI-Creativity Affects Their Collaborative PerformanceMia Magdalena Bangerl, Leonie Disch, Tamara David, Viktoria Pammer-SchindlerCHI 2025 · 13 citations
- The Value, Benefits, and Concerns of Generative AI-Powered Assistance in WritingZhuoyan Li, Chen Liang, Jing Peng, Ming YinCHI 2024 · 78 citations
- Decoupling of Usefulness and Novelty: Evaluating the Impact of Generative AI on Design Outputs and Novice Designers' Creative ThinkingYue Fu, Tony Zhou, Bin Han, Marx Wang et al.CHI 2026 · 2 citations
