Lune

CHI2025Top-tier venue

Misty: UI Prototyping Through Interactive Conceptual Blending

Yuwen Lu, Alan Leung, Amanda Swearngin, Jeffrey Nichols, Titus Barik

Abstract

UI prototyping often involves iterating and blending elements from examples such as screenshots and sketches, but current tools offer limited support for incorporating these examples. Inspired by the cognitive process of conceptual blending, we introduce a novel UI workflow that allows developers to rapidly incorporate diverse aspects from design examples into work-in-progress UIs. We prototyped this workflow as Misty. Through a exploratory first-use study with 14 frontend developers, we assessed Misty’s effectiveness and gathered feedback on this workflow. Our findings suggest that Misty’s conceptual blending workflow helps developers kickstart creative explorations, flexibly specify intent in different stages of prototyping, and inspires developers through serendipitous UI blends. Misty demonstrates the potential for tools that blur the boundaries between developers and designers.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

11 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs cites Language Models are Few-Shot Learners
  • Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • SQUIRE: Interactive UI Authoring via Slot QUery Intermediate REpresentations cites Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
  • DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAI cites Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
  • DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAI cites CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
  • DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAI cites User Experience Design Professionals' Perceptions of Generative Artificial Intelligence
  • CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI cites Language Models are Few-Shot Learners
  • Bridging Gulfs in UI Generation through Semantic Guidance cites Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
  • Bridging Gulfs in UI Generation through Semantic Guidance cites CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AI
  • Bridging Gulfs in UI Generation through Semantic Guidance cites User Experience Design Professionals' Perceptions of Generative Artificial Intelligence
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers11

  1. SQUIRE: Interactive UI Authoring via Slot QUery Intermediate REpresentationsAlan Leung, Ruijia Cheng, Jason Wu, Jeffrey Nichols et al.UIST 2025 · 4 citations
  2. DataWink: Reusing and Adapting SVG-Based Visualization Examples with Large Multimodal ModelsLiwenhan Xie, Yanna Lin, Can Liu, Huamin Qu et al.IEEE VIS 2025 · 3 citations
  3. DesignTrace: Exploring, Iterating and Tracking Design Alternatives with GenAIXiaohan Peng, Debanjana Haldar, Wendy E. Mackay, Janin KochCHI 2026 · 3 citations
  4. Bridging Gulfs in UI Generation through Semantic GuidanceSeokhyeon Park, Soohyun Lee, Eugene Choi, Hyunwoo Kim et al.CHI 2026 · 3 citations
  5. DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented InterfacesYuan Xu, Shaowen Xiang, Yizhi Song, Ruoting Sun et al.CHI 2026 · 2 citations

Builds on26

  1. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
  2. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  3. User Experience Design Professionals' Perceptions of Generative Artificial IntelligenceJie Li, Hancheng Cao, Laura Lin, Youyang Hou et al.CHI 2024 · 149 citations
  4. Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMsHariharan Subramonyam, Roy Pea, Christopher Lawrence Pondoc, Maneesh Agrawala et al.CHI 2024 · 137 citations
  5. CreativeConnect: Supporting Reference Recombination for Graphic Design Ideation with Generative AIDaEun Choi, Sumin Hong, Jeongeon Park, John Joon Young Chung et al.CHI 2024 · 116 citations

Related papers

  1. Umitation: Retargeting UI Behavior Examples for Website DesignYan Chen, Tovi GrossmanUIST 2021 · 6 citations
  2. CoCapture: Effectively Communicating UI Behaviors on Existing Websites by Demonstrating and RemixingYan Chen, Sang Won Lee, Steve OneyCHI 2021 · 12 citations
  3. GUIComp: A GUI Design Assistant with Real-Time, Multi-Faceted FeedbackChunggi Lee, Sanghoon Kim, Dongyun Han, Hongjun Yang et al.CHI 2020 · 61 citations
  4. IdeateRelate: An Examples Gallery That Helps Creators Explore Ideas in Relation to Their OwnXiaotong (Tone) Xu, Rosaleen Xiong, Boyang Wang, David Min et al.CSCW 2021 · 21 citations
  5. MetaMap: Supporting Visual Metaphor Ideation through Multi-dimensional Example-based ExplorationYouwen Kang, Zhida Sun, Sitong Wang, Zeyu Huang et al.CHI 2021 · 78 citations
Dusk over the sea between two cliffs drawn in fine vertical lines