GUIGAN: Learning to Generate GUI Designs Using Generative Adversarial Networks
Tianming Zhao, Chunyang Chen, Yuanning Liu, Xiaodong Zhu
Abstract
Graphical User Interface (GUI) is ubiquitous in almost all modern desktop software, mobile applications, and online websites. A good GUI design is crucial to the success of the software in the market, but designing a good GUI which requires much innovation and creativity is difficult even to well-trained designers. Besides, the requirement of the rapid development of GUI design also aggravates designers' working load. So, the availability of various automated generated GUIs can help enhance the design personalization and specialization as they can cater to the taste of different designers. To assist designers, we develop a model GUIGAN to automatically generate GUI designs. Different from conventional image generation models based on image pixels, our GUIGAN is to reuse GUI components collected from existing mobile app GUIs for composing a new design that is similar to natural-language generation. Our GUIGAN is based on SeqGAN by modeling the GUI component style compatibility and GUI structure. The evaluation demonstrates that our model significantly outperforms the best of the baseline methods by 30.77% in Fréchet Inception distance (FID) and 12.35% in 1-Nearest Neighbor Accuracy (1-NNA). Through a pilot user study, we provide initial evidence of the usefulness of our approach for generating acceptable brand new GUI designs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2e561865-e07a-49cc-a534-ad2120e490c3Cited by top-tier papers11
- Understanding Design Collaboration Between Designers and Artificial Intelligence: A Systematic Literature ReviewYang Shi, Tian Gao, Xiaohan Jiao, Nan CaoCSCW 2023 · 170 citations
- Investigating Positive and Negative Qualities of Human-in-the-Loop Optimization for Designing Interaction TechniquesLiwei Chan, Yi-Chi Liao, George B. Mo, John J. Dudley et al.CHI 2022 · 94 citations
- Guided Bug Crush: Assist Manual GUI Testing of Android Apps via Hint MovesZhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang et al.CHI 2022 · 38 citations
- GIFdroid: Automated Replay of Visual Bug Reports for Android AppsSidong Feng, Chunyang ChenICSE 2022 · 38 citations
- GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial NetworkMohammad Amin Mozaffari, Xinyuan Zhang, Jinghui Cheng, Jin L. C. GuoCHI 2022 · 32 citations
Builds on8
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- LayoutVAE: Stochastic Scene Layout Generation From a Label SetAkash Abdu Jyothi, Thibaut Durand, Jiawei He, Leonid Sigal et al.ICCV 2019 · 194 citations
- Object detection for graphical user interface: old fashioned or deep learning or a combination?Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen et al.FSE 2020 · 144 citations
- Unblind your apps: predicting natural-language labels for mobile GUI components by deep learningJieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu et al.ICSE 2020 · 101 citations
- Owl Eyes: Spotting UI Display Issues via Visual UnderstandingZhe Liu, Chunyang Chen, Junjie Wang, Yuekai Huang et al.ASE 2020 · 79 citations
Related papers
- Closing the Loop between User Stories and GUI Prototypes: An LLM-Based Assistant for Cross-Functional Integration in Software DevelopmentFelix Kretzer, Kristian Kolthoff, Christian Bartelt, Simone Paolo Ponzetto et al.CHI 2025 · 18 citations
- Graph4GUI: Graph Neural Networks for Representing Graphical User InterfacesYue Jiang, Changkong Zhou, Vikas Garg, Antti OulasvirtaCHI 2024 · 17 citations
- TiGAN: Text-Based Interactive Image Generation and ManipulationYufan Zhou, Ruiyi Zhang, Jiuxiang Gu, Chris Tensmeyer et al.AAAI 2022 · 18 citations
- Beyond Manual Modeling: Automating GUI Model Generation Using Design DocumentsShaoheng Cao, Renyi Chen, Minxue Pan, Wenhua Yang et al.ASE 2024 · 1 citation
- UIClip: A Data-driven Model for Assessing User Interface DesignJason Wu, Yi-Hao Peng, Xin Yue Amanda Li, Amanda Swearngin et al.UIST 2024 · 29 citations
