Progressive Photorealistic Simplification
Adi Rosenthal, Dana Berman, Yedid Hoshen, Ariel Shamir
摘要
Existing image simplification techniques often rely on Non-Photorealistic Rendering (NPR), transforming photographs into stylized sketches, cartoons, or paintings. While effective at reducing visual complexity, such approaches typically sacrifice photographic realism. In this work, we explore a complementary direction: simplifying images while preserving their photorealistic appearance. We introduce progressive semantic image simplification, a framework that iteratively reduces scene complexity by removing and inpainting elements in a controlled manner. At each step, the resulting image remains a plausible natural photograph. Our method combines semantic understanding with generative editing, leveraging Vision-Language Models (VLMs) to identify and prioritize elements for removal, and a learned verifier to ensure photorealism and coherence throughout the process. This is implemented via an iterative Select–Remove–Verify pipeline that produces high-quality simplification trajectories. To improve efficiency, we further distill this process into an image-to-video generation model that directly predicts coherent simplification sequences from a single input image. Beyond generating cleaner and more focused compositions, our approach enables applications such as content-aware decluttering, semantic layer decomposition, and interactive editing. More broadly, our work suggests that simplification through structured content removal can serve as a practical mechanism for guiding visual interpretation within the photorealistic domain, complementing traditional abstraction methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- CLIPasso: semantically-aware object sketchingYael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo, Roman Christian Bachmann 等SIGGRAPH 2022 · 被引用 219 次
- DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion ModelsXiming Xing, Chuang Wang, Haitao Zhou, Jing Zhang 等NeurIPS 2023 · 被引用 101 次
- CLIPascene: Scene Sketching with Different Types and Levels of AbstractionYael Vinker, Yuval Alaluf, Daniel Cohen-Or, Ariel ShamirICCV 2023 · 被引用 93 次
相关 Paper
- Prune Redundancy, Preserve Essence: Vision Token Compression in VLMs via Synergistic Importance-DiversityZhengyao Fang, Pengyuan Lyu, Chengquan Zhang, Guangming Lu 等ICLR 2026 · 被引用 25 次
- Vector Prism: Animating Vector Graphics by Stratifying Semantic StructureJooyeol Yun, Jaegul ChooCVPR 2026 · 被引用 2 次
- PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language ModelsChenyu Yang, Xuan Dong, Xizhou Zhu, Weijie Su 等CVPR 2025
- Dual-Process Image GenerationGrace Luo, Jonathan Granskog, Aleksander Holynski, Trevor DarrellICCV 2025 · 被引用 2 次
- Layered Image Vectorization via Semantic SimplificationZhenyu Wang, Jianxi Huang, Zhida Sun, Yuanhao Gong 等CVPR 2025
