Differences in Individual Metacognitive Awareness Make Cognitive Offloading Tools a Double-Edged Sword: The case of Spell-Checking Tools
Jianning Wei, Kazushi Nishimoto
Abstract
Cognitive offloading research typically assumes uniform effects across users, yet individual differences in metacognitive awareness may influence these effects differently. We examined how users' everyday spell-checking practices interact with their metacognitive awareness. Using a behavioral measure of awareness (proportion of errors detected and corrected), we conducted a 2×2 experiment (awareness × tool usage, n=88). Participants completed a three-phase spelling task-baseline, error review, and validation-with performance assessed by the number of spelling errors. Results revealed a significant interaction effect (𝐹 (1, 84) = 3.950, 𝑝 = .050, 𝜂 2 = .045): spell-checking tools minimally affected high-awareness users but resulted in significantly poorer performance among low-awareness users (𝑀 = 1.70 𝑣𝑠 . 𝑀 = 7.74, 𝑑 = 1.07). These findings suggest that cognitive offloading tools may have differential effects depending on users' metacognitive capabilities, raising considerations for incorporating individual differences into assistive technology design and questioning one-size-fits-all design assumptions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eb9262c0-4a98-4a4f-b3c7-c7a59e032314Builds on6
- The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge WorkersHao-Ping (Hank) Lee, Advait Sarkar, Lev Tankelevitch, Ian Drosos et al.CHI 2025 · 690 citations
- The Metacognitive Demands and Opportunities of Generative AILev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott et al.CHI 2024 · 279 citations
- The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English WritersDaniel Buschek, Martin Zürn, Malin EibandCHI 2021 · 106 citations
- Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language ModelsParamveer S. Dhillon, Somayeh Molaei, Jiaqi Li, Maximilian Golub et al.CHI 2024 · 102 citations
- Learning Behaviors Mediate the Effect of AI-powered Support for Metacognitive Calibration on Learning OutcomesHaejin Lee, Frank Stinar, Ruohan Zong, Hannah Valdiviejas et al.CHI 2025 · 18 citations
Related papers
- Adaptive Tool Use in Large Language Models with Meta-Cognition TriggerWenjun Li, Dexun Li, Kuicai Dong, Cong Zhang et al.ACL 2025
- The Differential Effects of Multisensory Attentional Cues on Task Performance in VR Depending on the Level of Cognitive Load and Cognitive CapacitySihyun Jeong, Jinwook Kim, Jeongmi LeeIEEE VR 2024 · 20 citations
- Students' Verbalized Metacognition During Computerized LearningNigel Bosch, Yingbin Zhang, Luc Paquette, Ryan Baker et al.CHI 2021 · 20 citations
- AwarenessBench: Assessing Cognitive Capabilities of Language ModelsXiaojian Li, Rongwu Xu, Tianyun Zhang, Yue Wang et al.ACL 2026
- Unmasking Dunning-Kruger Effect in Visual Reasoning & JudgmentMengyu Chen, Yijun Liu, Emily WallIEEE VIS 2024 · 6 citations
