GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networks
Tianming Zhao, Chunyang Chen, Yuanning Liu, Xiaodong Zhu
摘要
Graphical User Interface (GUI) is ubiquitous in almost all modern desktop software, mobile applications, and online websites. A good GUI design is crucial to the success of the software in the market, but designing a good GUI which requires much innovation and creativity is difficult even to well-trained designers. Besides, the requirement of the rapid development of GUI design also aggravates designers' working load. So, the availability of various automated generated GUIs can help enhance the design personalization and specialization as they can cater to the taste of different designers. To assist designers, we develop a model GUIGAN to automatically generate GUI designs. Different from conventional image generation models based on image pixels, our GUIGAN is to reuse GUI components collected from existing mobile app GUIs for composing a new design that is similar to natural-language generation. Our GUIGAN is based on SeqGAN by modeling the GUI component style compatibility and GUI structure. The evaluation demonstrates that our model significantly outperforms the best of the baseline methods by 30.77% in Fréchet Inception distance (FID) and 12.35% in 1-Nearest Neighbor Accuracy (1-NNA). Through a pilot user study, we provide initial evidence of the usefulness of our approach for generating acceptable brand new GUI designs.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewYang Shi, Tian Gao, Xiaohan Jiao, Nan CaoCSCW 2023 · 被引用 170 次
- Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction TechniquesLiwei Chan, Yi-Chi Liao, George B. Mo, John J. Dudley 等CHI 2022 · 被引用 94 次
- Guided Bug Crush: Assist Manual GUI Testing of Android Apps via Hint MovesZhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang 等CHI 2022 · 被引用 38 次
- GIFdroid: Automated Replay of Visual Bug Reports for Android AppsSidong Feng, Chunyang ChenICSE 2022 · 被引用 38 次
- GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial NetworkMohammad Amin Mozaffari, Xinyuan Zhang, Jinghui Cheng, Jin L. C. GuoCHI 2022 · 被引用 32 次
它引用的顶会 Paper8
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu 等ICCV 2019 · 被引用 794 次
- LayoutVAE: Stochastic Scene Layout Generation From a Label SetAkash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal 等ICCV 2019 · 被引用 194 次
- Object detection for graphical user interface: old fashioned or deep learning or a combination?Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen 等FSE 2020 · 被引用 144 次
- Unblind your apps: predicting natural-language labels for mobile GUI components by deep learningJieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu 等ICSE 2020 · 被引用 101 次
- Owl Eyes: Spotting UI Display Issues via Visual UnderstandingZhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang 等ASE 2020 · 被引用 79 次
相关 Paper
- Closing the Loop between User Stories and GUI Prototypes: An LLM-Based Assistant for Cross-Functional Integration in Software DevelopmentFelix Kretzer, Kristian Kolthoff, Christian Bartelt, Simone Paolo Ponzetto 等CHI 2025 · 被引用 18 次
- Graph4GUI: Graph Neural Networks for Representing Graphical User InterfacesYue Jiang, Changkong Zhou, Vikas Garg, Antti OulasvirtaCHI 2024 · 被引用 17 次
- TiGAN: Text-Based Interactive Image Generation and ManipulationYufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer 等AAAI 2022 · 被引用 18 次
- Beyond Manual Modeling: Automating GUI Model Generation Using Design DocumentsShaoheng Cao, Renyi Chen, Minxue Pan, Wenhua Yang 等ASE 2024 · 被引用 1 次
- UIClip: A Data-driven Model for Assessing User Interface DesignJason Wu, Yi-Hao Peng, Xin Yue Amanda Li, Amanda Swearngin 等UIST 2024 · 被引用 29 次
