LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions
Oguz Kaan Yüksel, Enis Simsar, Ezgi Gülperi Er, Pinar Yanardag
摘要
Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions enable controllable image generation and support a wide range of semantic editing operations, such as zoom or rotation. The discovery of such directions is often done in a supervised or semi-supervised manner and requires manual annotations which limits their use in practice. In comparison, unsupervised discovery allows finding subtle directions that are difficult to detect a priori. In this work, we propose a contrastive learning-based approach to discover se- † Equal contribution. Author ordering determined by a coin flip. mantic directions in the latent space of pre-trained GANs in a self-supervised manner. Our approach finds semantically meaningful dimensions comparable with state-of-theart methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper18
- High-Fidelity GAN Inversion for Image Attribute EditingTengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang 等CVPR 2022 · 被引用 227 次
- Understanding the Latent Space of Diffusion Models through the Lens of Riemannian GeometryYong-Hyun Park, Mingi Kwon, Jaewoong Choi, Junghyo Jo 等NeurIPS 2023 · 被引用 163 次
- HyperInverter: Improving StyleGAN Inversion via HypernetworkTan M. Dinh, Anh Tuan Tran, Rang Nguyen, Binh-Son HuaCVPR 2022 · 被引用 111 次
- Style Transformer for Image Inversion and EditingXueqi Hu, Qiusheng Huang, Zhengyi Shi, Siyuan Li 等CVPR 2022 · 被引用 58 次
- Diffusion Models Already Have A Semantic Latent SpaceMingi Kwon, Jaeseok Jeong, Youngjung UhICLR 2023 · 被引用 52 次
它引用的顶会 Paper11
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 被引用 1,049 次
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 被引用 459 次
- On the "steerability" of generative adversarial networksAli Jahanian, Lucy Chai, Phillip IsolaICLR 2020 · 被引用 421 次
- GANalyze: Toward Visual Definitions of Cognitive Image PropertiesLore Goetschalckx, Alex Andonian, Aude Oliva, Phillip IsolaICCV 2019 · 被引用 345 次
相关 Paper
- Self-Supervised Enhancement of Latent Discovery in GANsAdarsh Kappiyath, Silpa Vadakkeeveetil Sreelatha, S. SumitraAAAI 2022 · 被引用 3 次
- Navigating the GAN Parameter Space for Semantic Image EditingAnton Cherepkov, Andrey Voynov, Artem BabenkoCVPR 2021
- CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit DirectionsRameen Abdal, Peihao Zhu, John Femiani, Niloy J. Mitra 等SIGGRAPH 2022 · 被引用 76 次
- Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image TransformationsGuanyue Li, Yi Liu, Xiwen Wei, Yang Zhang 等ACM MM 2021 · 被引用 7 次
- GAN "Steerability" without optimizationNurit Spingarn, Ron Banner, Tomer MichaeliICLR 2021 · 被引用 59 次
