ClearFairy: Capturing Creative Workflows through Decision Structuring, In-Situ Questioning, and Rationale Inference
Kihoon Son, DaEun Choi, Tae Soo Kim, Young-Ho Kim, Sangdoo Yun, Juho Kim
摘要
Capturing professionals’ decision-making in creative workflows (e.g., UI/UX) is essential for reflection, collaboration, and knowledge sharing, yet existing methods often leave rationales incomplete and implicit decisions hidden. To address this, we present the Clear approach, which structures reasoning into cognitive decision steps—linked units of actions, artifacts, and explanations making decisions traceable with generative AI. Building on Clear, we introduce ClearFairy, a think-aloud AI assistant for UI design that detects weak explanations, asks lightweight clarifying questions, and infers missing rationales. In a study with twelve professionals, 85% of ClearFairy’s inferred rationales were accepted (as-is or with revisions). Notably, the system increased “strong explanations”—rationales providing sufficient causal reasoning—from 14% to 83% without adding cognitive demand. Furthermore, exploratory applications demonstrate that captured steps can enhance generative AI agents in Figma, yielding predictions better aligned with professionals and producing coherent outcomes. We release a dataset of 417 decision steps to support future research.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper28
- Generative Agents: Interactive Simulacra of Human BehaviorJoon Sung Park, Joseph C. O'Brien, Carrie Jun Cai, Meredith Ringel Morris 等UIST 2023 · 被引用 1,882 次
- The Effects of Generative AI on Design Fixation and Divergent ThinkingSamangi Wadinambiarachchi, Ryan M. Kelly, Saumya Pareek, Qiushi Zhou 等CHI 2024 · 被引用 186 次
- Don't Just Tell Me, Ask Me: AI Systems that Intelligently Frame Explanations as Questions Improve Human Logical Discernment Accuracy over Causal AI explanationsValdemar Danry, Pat Pataranutaporn, Yaoli Mao, Pattie MaesCHI 2023 · 被引用 108 次
- Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported DataJing Wei, Sungdong Kim, Hyunhoon Jung, Young-Ho KimCSCW 2024 · 被引用 82 次
- Generating Automatic Feedback on UI Mockups with Large Language ModelsPeitong Duan, Jeremy Warner, Yang Li, Bjoern HartmannCHI 2024 · 被引用 81 次
相关 Paper
- Co-Constructed or Constrained? How AI Collaboration Tools Reshape UI Design Practice in a Time-Boxed Design ChallengeCharlotte Kobiella, Lukas Schneider, Albrecht Schmidt, Nada TerzimehicCHI 2026 · 被引用 1 次
- Lost in Translation: The Value of Verbalizations in Interpreting 3D Computer-Aided Design WorkflowsKathy Cheng, Jo Vermeulen, George W. Fitzmaurice, Justin MatejkaCHI 2026 · 被引用 1 次
- Bridging Gulfs in UI Generation through Semantic GuidanceSeokhyeon Park, Soohyun Lee, Eugene Choi, Hyunwoo Kim 等CHI 2026 · 被引用 3 次
- Closing the Loop between User Stories and GUI Prototypes: An LLM-Based Assistant for Cross-Functional Integration in Software DevelopmentFelix Kretzer, Kristian Kolthoff, Christian Bartelt, Simone Paolo Ponzetto 等CHI 2025 · 被引用 18 次
- CritiqueCrew: Orchestrating Multi-Perspective Conversational Design CritiqueXiaojiao Chen, Jiahuan Zhou, Yunfeng Shu, Ruihan Wang 等CHI 2026 · 被引用 2 次
