Umitation: Retargeting UI Behavior Examples for Website Design
Yan Chen, Tovi Grossman
Abstract
Interface designers often refer to UI behavior examples found in the wild (e.g., commercial websites) for reference or design inspiration. While past research has looked at retargeting interface and webpage design, limited work has explored the challenges in retargeting interactive visual behaviors. We introduce Umitation, a system that helps designers extract, edit, and adapt example front-end UI behaviors to target websites. Umitation can also help designers specify the desired behaviors and reconcile their intended interaction details with their existing UI. In a qualitative evaluation, we found evidence that Umitation helps participants extract and retarget dynamic front-end UI behavior examples quickly and expressively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 255c6982-57bc-4f59-8354-c6274a24624dCited by top-tier papers5
- SemanticOn: Specifying Content-Based Semantic Conditions for Web Automation ProgramsKevin Pu, Rainey Fu, Rui Dong, Xinyu Wang et al.UIST 2022 · 16 citations
- DesignChecker: Visual Design Support for Blind and Low Vision Web DevelopersMina Huh, Amy PavelUIST 2024 · 13 citations
- Citizen-Led Personalization of User Interfaces: Investigating How People Customize Interfaces for Themselves and OthersSérgio Alves, Ricardo Costa, Kyle Montague, Tiago João GuerreiroCSCW 2024 · 6 citations
- DiLogics: Creating Web Automation Programs with Diverse LogicsKevin Pu, Jim Yang, Angel Yuan, Minyi Ma et al.UIST 2023 · 5 citations
- Beyond Input-Output: Rethinking Creativity through Design-by-Analogy in Human-AI CollaborationXuechen Li, Shuai Zhang, Nan Cao, Qing ChenCHI 2026 · 2 citations
Builds on8
- Everybody Dance NowCaroline Chan, Shiry Ginosar, Tinghui Zhou, Alexei A. EfrosICCV 2019 · 840 citations
- Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and EnactionGermán Leiva, Cuong Nguyen, Rubaiat Habib Kazi, Paul AsenteCHI 2020 · 96 citations
- B2: Bridging Code and Interactive Visualization in Computational NotebooksYifan Wu, Joseph M. Hellerstein, Arvind SatyanarayanUIST 2020 · 71 citations
- Scout: Rapid Exploration of Interface Layout Alternatives through High-Level Design ConstraintsAmanda Swearngin, Chenglong Wang, Alannah Oleson, James Fogarty et al.CHI 2020 · 58 citations
- ICONATE: Automatic Compound Icon Generation and IdeationNanxuan Zhao, Nam Wook Kim, Laura Mariah Herman, Hanspeter Pfister et al.CHI 2020 · 49 citations
Related papers
- CoCapture: Effectively Communicating UI Behaviors on Existing Websites by Demonstrating and RemixingYan Chen, Sang Won Lee, Steve OneyCHI 2021 · 12 citations
- Misty: UI Prototyping Through Interactive Conceptual BlendingYuwen Lu, Alan Leung, Amanda Swearngin, Jeffrey Nichols et al.CHI 2025 · 41 citations
- VINS: Visual Search for Mobile User Interface DesignSara Bunian, Kai Li, Chaima Jemmali, Casper Harteveld et al.CHI 2021 · 100 citations
- CANVAS: A Benchmark for Vision-Language Models on Tool-Based User Interface DesignDaeheon Jeong, Seoyeon Byun, Kihoon Son, Dae Hyun Kim et al.AAAI 2026
- Benchmarking Web Agent Safety under E-commerce Deceptive InterfacesZijing Shi, Meng Fang, Ling ChenACL 2026
