Lune

CHI2026Top-tier venue

Instructional Mechanisms for Professional Writing: A Comparison of Scaffolded Annotation and ChatGPT

Shanley Corvite, Rebecca L. Matz, Mark Mills, Julie Hui

Abstract

Professional writing skills are essential for crafting job application materials where applicants showcase their qualifications to recruiters and employers. Lettersmith is a digital tool that supports writing through scaffolded annotation, an instructional approach combining an expert-informed checklist, annotated examples, and self-tagging. We evaluated the efficacy of the instructional mechanisms that make up scaffolded annotation, as well as the use of ChatGPT, in facilitating writing cognitive processes and writing quality. Through a lab experiment with 146 first-year college students writing and revising a cover letter, we found that the combined mechanisms of scaffolded annotation within Lettersmith promoted a stronger understanding of the writing genre. Specifically, the use of a checklist combined with another writing support, like an example or self-tagging, was particularly effective for improving writing quality. Unstructured use of ChatGPT did not improve writing cognitive processes or writing quality more than Lettersmith.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

its abstract · related work

Get the answer

Free to start. No credit card required.

Related papers

  1. Lettersmith: Scaffolding Written Professional Communication Among College StudentsJulie Hui, Michelle L. SprouseCHI 2023 · 21 citations
  2. Shaping Human-AI Collaboration: Varied Scaffolding Levels in Co-writing with Language ModelsParamveer S. Dhillon, Somayeh Molaei, Jiaqi Li, Maximilian Golub et al.CHI 2024 · 102 citations
  3. An Empirical Study to Understand How Students Use ChatGPT for Writing EssaysAndrew Jelson, Daniel Manesh, Alice Jang, Daniel Dunlap et al.CHI 2026 · 3 citations
  4. Intelligent Support Engages Writers Through Relevant Cognitive ProcessesAndreas Göldi, Thiemo Wambsganss, Seyed Parsa Neshaei, Roman RietscheCHI 2024 · 20 citations
  5. VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft PrototypingZheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, Toby Jia-Jun LiUIST 2023 · 101 citations
Dusk over the sea between two cliffs drawn in fine vertical lines