Picture that Sketch: Photorealistic Image Generation from Abstract Sketches
Subhadeep Koley, Ayan Kumar Bhunia, Aneeshan Sain, Pinaki Nath Chowdhury, Tao Xiang, Yi-Zhe Song
Abstract
Edgemap Sketch Sketch Sketch Sketch Sketch Existing Methods Proposed Method Figure 1. (a) Set of photos generated by the proposed method. (b) While existing methods can generate faithful photos from perfectly pixel-aligned edgemaps, they fall short drastically in case of highly deformed and sparse free-hand sketches. In contrast, our autoregressive sketch-to-photo generation model produces highly photorealistic outputs from highly abstract sketches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 340c1873-58ec-429d-9c61-a75e618fdfc3Cited by top-tier papers27
- SketchFlex: Facilitating Spatial-Semantic Coherence in Text-to-Image Generation with Region-Based SketchesHaichuan Lin, Yilin Ye, Jiazhi Xia, Wei ZengCHI 2025 · 25 citations
- Completing Visual Objects via Bridging Generation and SegmentationXiang Li, Yinpeng Chen, Chung-Ching Lin, Hao Chen et al.ICML 2024 · 3 citations
- LOTS of Fashion! Multi-Conditioning for Image Generation via Sketch-Text PairingFederico Girella, Davide Talon, Ziyue Liu, Zanxi Ruan et al.ICCV 2025 · 2 citations
- ChArtist: Generating Pictorial Charts with Unified Spatial and Subject ControlShishi Xiao, Tongyu Zhou, David H. Laidlaw, Gromit Yeuk-Yin ChanCVPR 2026 · 2 citations
- Scalable Dual Fingerprinting for Hierarchical Attribution of Text-to-Image ModelsJianwei Fei, Yunshu Dai, Peipeng Yu, Zhe Kong et al.ICCV 2025 · 1 citation
Builds on36
- On the Variance of the Adaptive Learning Rate and BeyondLiyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen et al.ICLR 2020 · 2,210 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image TranslationJunho Kim, Minjae Kim, Hyeonwoo Kang, Kwanghee LeeICLR 2020 · 632 citations
- ReStyle: A Residual-Based StyleGAN Encoder via Iterative RefinementYuval Alaluf, Or Patashnik, Daniel Cohen-OrICCV 2021 · 377 citations
Related papers
- It's All About Your Sketch: Democratising Sketch Control in Diffusion ModelsSubhadeep Koley, Ayan Kumar Bhunia, Deeptanshu Sekhri, Aneeshan Sain et al.CVPR 2024
- SketchingReality: From Freehand Scene Sketches to Photorealistic ImagesAhmed Bourouis, Mikhail Bessmeltsev, Yulia GryaditskayaICLR 2026 · 3 citations
- DeepFacePencil: Creating Face Images from Freehand SketchesYuhang Li, Xuejin Chen, Binxin Yang, Zihan Chen et al.ACM MM 2020 · 56 citations
- SketchyCOCO: Image Generation From Freehand Scene SketchesChengying Gao, Qi Liu, Qi Xu, Limin Wang et al.CVPR 2020
- DeepFaceDrawing: deep generation of face images from sketchesShu-Yu Chen, Wanchao Su, Lin Gao, Shihong Xia et al.SIGGRAPH 2020 · 145 citations
