Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs
Hui-Po Wang, Ning Yu, Mario Fritz
摘要
While Generative Adversarial Networks (GANs) show increasing performance and the level of realism is becoming indistinguishable from natural images, this also comes with high demands on data and computation. We show that state-of-the-art GAN models -such as they are being publicly released by researchers and industry -can be used for a range of applications beyond unconditional image generation. We achieve this by an iterative scheme that also allows gaining control over the image generation process despite the highly non-linear latent spaces of the latest GAN models. We demonstrate that this opens up the possibility to re-use state-of-the-art, difficult to train, pre-trained GANs with a high level of control even if only black-box access is granted. Our work also raises concerns and awareness that the use cases of a published GAN model may well reach beyond the creators' intention, which needs to be taken into account before a full public release. Code is available at https://github.com/a514514772/hijackgan .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper8
- Dual Contrastive Loss and Attention for GANsNing Yu, Guilin Liu, Aysegul Dundar, Andrew Tao 等ICCV 2021 · 被引用 69 次
- StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video GenerationYuhan Wang, Liming Jiang, Chen Change LoyICCV 2023 · 被引用 20 次
- Attribute-specific Control Units in StyleGAN for Fine-grained Image ManipulationRui Wang, Jian Chen, Gang Yu, Li Sun 等ACM MM 2021 · 被引用 13 次
- ReGANIE: Rectifying GAN Inversion Errors for Accurate Real Image EditingBingchuan Li, Tianxiang Ma, Peng Zhang, Miao Hua 等AAAI 2023 · 被引用 11 次
- PluGeN: Multi-Label Conditional Generation from Pre-trained ModelsMaciej Wolczyk, Magdalena Proszewska, Lukasz Maziarka, Maciej Zieba 等AAAI 2022 · 被引用 8 次
它引用的顶会 Paper13
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 被引用 1,195 次
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 被引用 1,049 次
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 被引用 459 次
- On the "steerability" of generative adversarial networksAli Jahanian, Lucy Chai, Phillip IsolaICLR 2020 · 被引用 421 次
- GANalyze: Toward Visual Definitions of Cognitive Image PropertiesLore Goetschalckx, Alex Andonian, Aude Oliva, Phillip IsolaICCV 2019 · 被引用 345 次
相关 Paper
- Sketch Your Own GANSheng-Yu Wang, David Bau, Jun-Yan ZhuICCV 2021 · 被引用 82 次
- Towards Discovery and Attribution of Open-world GAN Generated ImagesSharath Girish, Saksham Suri, Sai Saketh Rambhatla, Abhinav ShrivastavaICCV 2021 · 被引用 87 次
- Interpreting the Latent Space of GANs for Semantic Face EditingYujun Shen, Jinjin Gu, Xiaoou Tang, Bolei ZhouCVPR 2020
- Designing an encoder for StyleGAN image manipulationOmer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik 等SIGGRAPH 2021 · 被引用 692 次
- Using latent space regression to analyze and leverage compositionality in GANsLucy Chai, Jonas Wulff, Phillip IsolaICLR 2021 · 被引用 30 次
