DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
Sirui Tao, Ivan Liang, Cindy Peng, Zhiqing Wang, Srishti Palani, Steven P. Dow
Abstract
Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that effectively explore a product design space. To understand how experts explore and communicate about design spaces, we conducted a formative study with 12 experienced product designers and found that experts -- and their less-versed clients -- often use visual references to guide co-design discussions rather than written descriptions. These insights inspired DesignWeaver, an interface that helps novices generate prompts for a text-to-image model by surfacing key product design dimensions from generated images into a palette for quick selection. In a study with 52 novices, DesignWeaver enabled participants to craft longer prompts with more domain-specific vocabularies, resulting in more diverse, innovative product designs. However, the nuanced prompts heightened participants' expectations beyond what current text-to-image models could deliver. We discuss implications for AI-based product design support tools.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- "It Became My Buddy, But I'm Not Afraid to Disagree": A Multi-Session Study of UX Evaluators Collaborating with Conversational AI AssistantsEmily Kuang, Ehsan Jahangirzadeh Soure, Luyao Shen, Nitesh Goyal et al.CHI 2026 · 3 citations
- DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAIXiaohan Peng, Debanjana Haldar, Wendy E. Mackay, Janin KochCHI 2026 · 3 citations
- Noise Pilot: Enabling Artistic Workflow Composition with Diffusion-Based Image GenerationJames Smith, Shm Garanganao Almeda, Timothy J. Aveni, Anya Agarwal et al.CHI 2026 · 3 citations
- "It's Just a Wild, Wild West": Harnessing Public Procurement as an AI Governance MechanismAnna Ida Hudig, Emma Kallina, Jatinder SinghCHI 2026 · 2 citations
- AIDED: Augmenting Interior Design with Human Experience Data for Designer-AI Co-DesignYang Chen Lin, Chen-Ying Chien, Kai-Hsin Hou, Hung-Yu Chen et al.CHI 2026 · 2 citations
Builds on46
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, Lala Li et al.NeurIPS 2022 · 8,965 citations
Related papers
- Prompting for Discovery: Flexible Sense-Making for AI Art-Making with DreamsheetsShm Garanganao Almeda, J. D. Zamfirescu-Pereira, Kyu Won Kim, Pradeep Mani Rathnam et al.CHI 2024 · 46 citations
- Is It AI or Is It Me? Understanding Users' Prompt Journey with Text-to-Image Generative AI ToolsAtefeh Mahdavi Goloujeh, Anne Sullivan, Brian MagerkoCHI 2024 · 88 citations
- InspirationGraph for Progressive Design Space ExplorationSuxiang Ling, Yi Xiao, Yang Zhou, Ruoxuan Ma et al.CHI 2026
- ProductMeta: An Interactive System for Metaphorical Product Design Ideation with Multimodal Large Language ModelsQinyi Zhou, Jie Deng, Yu Liu, Yun Wang et al.CHI 2025 · 13 citations
- Inkspire: Supporting Design Exploration with Generative AI through Analogical SketchingDavid Chuan-En Lin, Hyeonsu B. Kang, Nikolas Martelaro, Aniket Kittur et al.CHI 2025 · 56 citations
