The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers
Hao-Ping (Hank) Lee, Advait Sarkar, Lev Tankelevitch, Ian Drosos, Sean Rintel, Richard Banks, Nicholas C. Wilson
Abstract
The rise of Generative AI (GenAI) in knowledge workflows raises questions about its impact on critical thinking skills and practices. We survey 319 knowledge workers to investigate 1) when and how they perceive the enaction of critical thinking when using GenAI, and 2) when and why GenAI affects their effort to do so. Participants shared 936 first-hand examples of using GenAI in work tasks. Quantitatively, when considering both task-and user-specific factors, a user's task-specific self-confidence and confidence in GenAI are predictive of whether critical thinking is enacted and the effort of doing so in GenAI-assisted tasks. Specifically, higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more critical thinking. Qualitatively, GenAI shifts the nature of critical thinking toward information verification, response integration, and task stewardship. Our insights reveal new design challenges and opportunities for developing GenAI tools for knowledge work.
• Human-centered computing → Empirical studies in HCI.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers36
- Exploring Collaborative GenAI Agents in Synchronous Group Settings: Eliciting Team Perceptions and Design Considerations for the Future of WorkJanet G. Johnson, Macarena Peralta, Mansanjam Kaur, Ruijie Sophia Huang et al.CSCW 2025 · 16 citations
- How Do Programming Students Use Generative AI?Christian Rahe, Walid MaalejFSE 2025 · 12 citations
- Invisible Saboteurs: Sycophantic LLMs Mislead Novices in Problem-Solving TasksJessica Y. Bo, Majeed Kazemitabaar, Mengqing Deng, Michael Inzlicht et al.CHI 2026 · 8 citations
- AI and My Values: User Perceptions of LLMs' Ability to Extract, Embody, and Explain Human Values from Casual ConversationsBhada Yun, Renn Su, April Yi WangCHI 2026 · 7 citations
- From Future of Work to Future of Workers: Addressing Asymptomatic AI Harms to Foster Dignified Human-AI InteractionUpol Ehsan, Samir Passi, Koustuv Saha, Todd McNutt et al.CHI 2026 · 7 citations
Builds on20
- To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-makingZana Buçinca, Maja Barbara Malaya, Krzysztof Z. GajosCSCW 2021 · 962 citations
- The Metacognitive Demands and Opportunities of Generative AILev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott et al.CHI 2024 · 279 citations
- Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with ExplanationsValerie Chen, Q. Vera Liao, Jennifer Wortman Vaughan, Gagan BansalCSCW 2023 · 146 citations
- ArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation SkillsThiemo Wambsganss, Tobias Kueng, Matthias Söllner, Jan Marco LeimeisterCHI 2021 · 126 citations
- Human Reliance on Machine Learning Models When Performance Feedback is Limited: Heuristics and RisksZhuoran Lu, Ming YinCHI 2021 · 123 citations
Related papers
- How the Role of Generative AI Shapes Perceptions of Value in Human-AI Collaborative WorkAaron Schecter, Benjamin RichardsonCHI 2025 · 6 citations
- When Designers Sweat: Behavioral Traces of GenAI Co-CreationElena Cavallin, Simone SpagnolCHI 2026 · 2 citations
- "I want it to talk like Darth Vader": Helping Children Construct Creative Self-Efficacy with Generative AIMichele Newman, Kaiwen Sun, Ilena B. Dalla Gasperina, Grace Y. Shin et al.CHI 2024 · 58 citations
- How Knowledge Workers Think Generative AI Will (Not) Transform Their IndustriesAllison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Rousso-Schindler et al.CHI 2024 · 109 citations
- When Teams Embrace AI: Human Collaboration Strategies in Generative Prompting in a Creative Design TaskYuanning Han, Ziyi Qiu, Jiale Cheng, Ray LCCHI 2024 · 103 citations
