GANzilla: User-Driven Direction Discovery in Generative Adversarial Networks
Noyan Evirgen, Xiang 'Anthony' Chen
Abstract
Figure 1: GANzilla is a tool that allows users to discover editing directions in Generative Adversarial Networks (GAN) via iterative scatter/gather interactions-a user-driven approach that complements many existing algorithm-driven methods. (a) A user starts by highlighting a region of interest (an optional step). (b) Based on the highlight (if there is), directions are sampled and clustered, each shown as an image edited by that direction. The user can gather clusters by selecting thumbnail images (indicated by a red border). (c) The user can see all the directions of the gathered clusters and (d) scatter them into new clusters. (e) The user can go back-and-forth across iterations to explore alternate choices of scatter/gather. (f) The user can test a selected direction (red border in c) on other images with individual sliders controlling the strength to apply the direction. (g) The user can bookmark directions that meet their editing goals.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language ModelsStephen Brade, Bryan Wang, Maurício Sousa, Sageev Oore et al.UIST 2023 · 179 citations
- PromptCharm: Text-to-Image Generation through Multi-modal Prompting and RefinementZhijie Wang, Yuheng Huang, Da Song, Lei Ma et al.CHI 2024 · 111 citations
- Prompting for Discovery: Flexible Sense-Making for AI Art-Making with DreamsheetsShm Garanganao Almeda, J. D. Zamfirescu-Pereira, Kyu Won Kim, Pradeep Mani Rathnam et al.CHI 2024 · 46 citations
- Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooMMichelle S. Lam, Janice Teoh, James A. Landay, Jeffrey Heer et al.CHI 2024 · 46 citations
- Augmenting Pathologists with NaviPath: Design and Evaluation of a Human-AI Collaborative Navigation SystemHongyan Gu, Chunxu Yang, Mohammad Haeri, Jing Wang et al.CHI 2023 · 32 citations
Builds on16
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- StyleCLIP: Text-Driven Manipulation of StyleGAN ImageryOr Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or et al.ICCV 2021 · 1,437 citations
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 459 citations
- On the "steerability" of generative adversarial networksAli Jahanian, Lucy Chai, Phillip IsolaICLR 2020 · 421 citations
Related papers
- GANravel: User-Driven Direction Disentanglement in Generative Adversarial NetworksNoyan Evirgen, Xiang Anthony ChenCHI 2023 · 15 citations
- LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable DirectionsOguz Kaan Yüksel, Enis Simsar, Ezgi Gülperi Er, Pinar YanardagICCV 2021 · 71 citations
- Navigating the GAN Parameter Space for Semantic Image EditingAnton Cherepkov, Andrey Voynov, Artem BabenkoCVPR 2021
- GANSpiration: Balancing Targeted and Serendipitous Inspiration in User Interface Design with Style-Based Generative Adversarial NetworkMohammad Amin Mozaffari, Xinyuan Zhang, Jinghui Cheng, Jin L. C. GuoCHI 2022 · 32 citations
- Method for Exploring Generative Adversarial Networks (GANs) via Automatically Generated Image GalleriesEnhao Zhang, Nikola BanovicCHI 2021 · 28 citations
