LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions
Oguz Kaan Yüksel, Enis Simsar, Ezgi Gülperi Er, Pinar Yanardag
Abstract
Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions enable controllable image generation and support a wide range of semantic editing operations, such as zoom or rotation. The discovery of such directions is often done in a supervised or semi-supervised manner and requires manual annotations which limits their use in practice. In comparison, unsupervised discovery allows finding subtle directions that are difficult to detect a priori. In this work, we propose a contrastive learning-based approach to discover se- † Equal contribution. Author ordering determined by a coin flip. mantic directions in the latent space of pre-trained GANs in a self-supervised manner. Our approach finds semantically meaningful dimensions comparable with state-of-theart methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 30b843cc-7274-4fef-80e1-693cb837b051Cited by top-tier papers18
- High-Fidelity GAN Inversion for Image Attribute EditingTengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang et al.CVPR 2022 · 227 citations
- Understanding the Latent Space of Diffusion Models through the Lens of Riemannian GeometryYong-Hyun Park, Mingi Kwon, Jaewoong Choi, Junghyo Jo et al.NeurIPS 2023 · 163 citations
- HyperInverter: Improving StyleGAN Inversion via HypernetworkTan M. Dinh, Anh Tuan Tran, Rang Nguyen, Binh-Son HuaCVPR 2022 · 111 citations
- Style Transformer for Image Inversion and EditingXueqi Hu, Qiusheng Huang, Zhengyi Shi, Siyuan Li et al.CVPR 2022 · 58 citations
- Diffusion Models Already Have A Semantic Latent SpaceMingi Kwon, Jaeseok Jeong, Youngjung UhICLR 2023 · 52 citations
Builds on11
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- GANSpace: Discovering Interpretable GAN ControlsErik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain ParisNeurIPS 2020 · 1,049 citations
- Unsupervised Discovery of Interpretable Directions in the GAN Latent SpaceAndrey Voynov, Artem BabenkoICML 2020 · 459 citations
- On the "steerability" of generative adversarial networksAli Jahanian, Lucy Chai, Phillip IsolaICLR 2020 · 421 citations
- GANalyze: Toward Visual Definitions of Cognitive Image PropertiesLore Goetschalckx, Alex Andonian, Aude Oliva, Phillip IsolaICCV 2019 · 345 citations
Related papers
- Self-Supervised Enhancement of Latent Discovery in GANsAdarsh Kappiyath, Silpa Vadakkeeveetil Sreelatha, S. SumitraAAAI 2022 · 3 citations
- Navigating the GAN Parameter Space for Semantic Image EditingAnton Cherepkov, Andrey Voynov, Artem BabenkoCVPR 2021
- CLIP2StyleGAN: Unsupervised Extraction of StyleGAN Edit DirectionsRameen Abdal, Peihao Zhu, John Femiani, Niloy J. Mitra et al.SIGGRAPH 2022 · 76 citations
- Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image TransformationsGuanyue Li, Yi Liu, Xiwen Wei, Yang Zhang et al.ACM MM 2021 · 7 citations
- GAN "Steerability" without optimizationNurit Spingarn, Ron Banner, Tomer MichaeliICLR 2021 · 59 citations
