Neural Implicit Morphing of Face Images
Guilherme G. Schardong, Tiago Novello, Hallison Paz, Iurii Medvedev, Vinícius da Silva, Luiz Velho, Nuno Gonçalves
摘要
Face morphing is a problem in computer graphics with numerous artistic and forensic applications. It is challenging due to variations in pose, lighting, gender, and ethnicity. This task consists of a warping for feature alignment and a blending for a seamless transition between the warped images. We propose to leverage coord-based neural networks to represent such warpings and blendings of face images. During training, we exploit the smoothness and flexibility of such networks by combining energy functionals employed in classical approaches without discretizations. Additionally, our method is time-dependent, allowing a continuous warping/blending of the images. During morphing inference, we need both direct and inverse transformations of the time-dependent warping. The first (second) is responsible for warping the target (source) image into the source (target) image. Our neural warping stores those maps in a single network dismissing the need for inverting them. The results of our experiments indicate that our method is competitive with both classical and generative models under the lens of image quality and face-morphing detectors. Aesthetically, the resulting images present a seamless blending of diverse faces not yet usual in the literature.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper6
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 被引用 11,743 次
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen 等NeurIPS 2021 · 被引用 2,126 次
- Diffusion Autoencoders: Toward a Meaningful and Decodable RepresentationKonpat Preechakul, Nattanat Chatthee, Suttisak Wizadwongsa, Supasorn SuwajanakornCVPR 2022 · 被引用 276 次
- Learning Smooth Neural Functions via Lipschitz RegularizationHsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler 等SIGGRAPH 2022 · 被引用 63 次
- Neural Implicit Surface EvolutionTiago Novello, Vinícius da Silva, Guilherme G. Schardong, Luiz Schirmer 等ICCV 2023 · 被引用 23 次
相关 Paper
- NeuroMorph: Unsupervised Shape Interpolation and Correspondence in One GoMarvin Eisenberger, David Novotný, Gael Kerchenbaum, Patrick Labatut 等CVPR 2021
- A 3D GAN for Improved Large-Pose Facial RecognitionRichard T. Marriott, Sami Romdhani, Liming ChenCVPR 2021
- Anatomically Constrained Implicit Face ModelsPrashanth Chandran, Gaspard ZossCVPR 2024
- FNeVR: Neural Volume Rendering for Face AnimationBohan Zeng, Boyu Liu, Hong Li, Xuhui Liu 等NeurIPS 2022 · 被引用 34 次
- Deep Shapely PortraitsQinjie Xiao, Xiangjun Tang, You Wu, Leyang Jin 等ACM MM 2020 · 被引用 11 次
