CRAFT: Exploring Wearable Creative AI on Smart Glasses for Fiction Writing in Real-World Contexts
Runze Cai, Yuxuan Huang, Lin-Ping Yuan, Kexin Xiang, David Hsu, Collier Nogues, Jussi Holopainen, Shengdong Zhao
Abstract
Creative writing increasingly integrates AI assistance, yet current tools miss in-situ moments when writers draw inspiration from real-world experiences. We envision Context-aware Reality-Fiction Transformation (CRAFT ), an approach for AI glasses that translates daily experiences into fiction narratives. We explored its desirability, feasibility, and potential viability through three studies. Interviews with nine writers yielded desires and three design goals: 1) augmenting in-situ perception to bridge reality-fiction gaps, 2) promoting authenticity grounded in real-world experiences while maintaining fictionalization, and 3) preserving creative agency, enjoyment, and life-art boundaries. Co-design workshops with 16 writers and researchers operationalized these goals into concrete interaction mechanisms using a technology probe. We then conducted supported field trials with eight writers across 24 sessions using a refined probe, revealing writer-perceived benefits (e.g., enriched fictional ideas from serendipitous encounters), emergent practices (e.g., micro-creation), and design considerations for future sustained use. We contribute design explorations for the CRAFT approach, offering design implications and empirical insights on ubiquitous human-AI creative collaboration in everyday life.
CCS Concepts: • Human-centered computing → Ubiquitous and mobile computing systems and tools; Empirical studies in interaction design.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5c5eba1e-914b-495a-b627-e0bae5c0c62fBuilds on37
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Searching for MobileNetV3Andrew Howard, Ruoming Pang, Hartwig Adam, Quoc V. Le et al.ICCV 2019 · 9,163 citations
- MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained TransformersWenhui Wang, Furu Wei, Li Dong, Hangbo Bao et al.NeurIPS 2020 · 2,727 citations
- Co-Writing Screenplays and Theatre Scripts with Language Models: Evaluation by Industry ProfessionalsPiotr Mirowski, Kory W. Mathewson, Jaylen Pittman, Richard EvansCHI 2023 · 235 citations
Related papers
- Where Do I 'Add the Egg'?: Exploring Agency and Ownership in AI Creative Co-Writing SystemsDashiel Carrera, Jeb Thomas-Mitchell, Daniel WigdorCHI 2026 · 2 citations
- PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XREsen K. Tütüncü, Qian Zhou, Frederik Brudy, George W. Fitzmaurice et al.CHI 2026 · 2 citations
- Co-Writing with AI, on Human Terms: Aligning Research with User Demands Across the Writing ProcessMohi Reza, Jeb Thomas-Mitchell, Peter Dushniku, Nathan Laundry et al.CSCW 2025 · 29 citations
- Vistoria: A Multimodal System to Support Fictional Story Writing through Instrumental Image-Text Co-EditingKexue Fu, Jingfei Huang, Long Ling, Sumin Hong et al.CHI 2026 · 3 citations
- Creative Reflections on Image-Making with Artificial Intelligence: Interactions with a Provocative 'Camera'Rowan Page, Jian Shin SeeCHI 2025 · 6 citations
