Progressive Photorealistic Simplification
Adi Rosenthal, Dana Berman, Yedid Hoshen, Ariel Shamir
Abstract
Existing image simplification techniques often rely on Non-Photorealistic Rendering (NPR), transforming photographs into stylized sketches, cartoons, or paintings. While effective at reducing visual complexity, such approaches typically sacrifice photographic realism. In this work, we explore a complementary direction: simplifying images while preserving their photorealistic appearance. We introduce progressive semantic image simplification, a framework that iteratively reduces scene complexity by removing and inpainting elements in a controlled manner. At each step, the resulting image remains a plausible natural photograph. Our method combines semantic understanding with generative editing, leveraging Vision-Language Models (VLMs) to identify and prioritize elements for removal, and a learned verifier to ensure photorealism and coherence throughout the process. This is implemented via an iterative Select–Remove–Verify pipeline that produces high-quality simplification trajectories. To improve efficiency, we further distill this process into an image-to-video generation model that directly predicts coherent simplification sequences from a single input image. Beyond generating cleaner and more focused compositions, our approach enables applications such as content-aware decluttering, semantic layer decomposition, and interactive editing. More broadly, our work suggests that simplification through structured content removal can serve as a practical mechanism for guiding visual interpretation within the photorealistic domain, complementing traditional abstraction methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d6681cef-7fc7-4283-9b66-dbbdae1971faBuilds on8
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
- CLIPasso: semantically-aware object sketchingYael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo, Roman Christian Bachmann et al.SIGGRAPH 2022 · 219 citations
- DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion ModelsXiming Xing, Chuang Wang, Haitao Zhou, Jing Zhang et al.NeurIPS 2023 · 101 citations
- CLIPascene: Scene Sketching with Different Types and Levels of AbstractionYael Vinker, Yuval Alaluf, Daniel Cohen-Or, Ariel ShamirICCV 2023 · 93 citations
Related papers
- Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-DiversityZhengyao Fang, Pengyuan Lyu, Chengquan Zhang, Guangming Lu et al.ICLR 2026 · 25 citations
- Vector Prism: Animating Vector Graphics by Stratifying Semantic StructureJooyeol Yun, Jaegul ChooCVPR 2026 · 2 citations
- PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language ModelsChenyu Yang, Xuan Dong, Xizhou Zhu, Weijie Su et al.CVPR 2025
- Dual-Process Image GenerationGrace Luo, Jonathan Granskog, Aleksander Holynski, Trevor DarrellICCV 2025 · 2 citations
- Layered Image Vectorization via Semantic SimplificationZhenyu Wang, Jianxi Huang, Zhida Sun, Yuanhao Gong et al.CVPR 2025
