Omnipaint: Mastering Object-Oriented Editing Via Disentangled Insertion-Removal Inpainting
Yongsheng Yu, Ziyun Zeng, Haitian Zheng, Jiebo Luo
摘要
Diffusion-based generative models have revolutionized object-oriented image editing, yet their deployment in realistic object removal and insertion remains hampered by challenges such as the intricate interplay of physical effects and insufficient paired training data. In this work, we introduce OmniPaint, a unified framework that re-conceptualizes object removal and insertion as interdependent processes rather than isolated tasks. Leveraging a pre-trained diffusion prior along with a progressive training pipeline comprising initial paired sample optimization and subsequent large-scale unpaired refinement via CycleFlow, OmniPaint achieves precise foreground elimination and seamless object insertion while faithfully preserving scene geometry and intrinsic properties. Furthermore, our novel CFD metric offers a robust, reference-free evaluation of context consistency and object hallucination, establishing a new benchmark for high-fidelity image editing. Project page: https://yeates.github.io/OmniPaint-Page/
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper11
- EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect ErasingYANG FU, Yike Zheng, Ziyun Dai, Henghui DingCVPR 2026 · 被引用 14 次
- Precise Object and Effect Removal with Adaptive Target-Aware AttentionJixin Zhao, Zhouxia Wang, Peiqing Yang, Shangchen ZhouCVPR 2026 · 被引用 13 次
- GeoRemover: Removing Objects and Their Causal Visual ArtifactsZixin Zhu, Haoxiang Li, Xuelu Feng, He Wu 等NeurIPS 2025 · 被引用 11 次
- PixPerfect: Seamless Latent Diffusion Local Editing with Discriminative Pixel-Space RefinementHaitian Zheng, Yuan Yao, Yongsheng Yu, Yuqian Zhou 等NeurIPS 2025 · 被引用 3 次
- HOComp: Interaction-Aware Human-Object CompositionDong Liang, Jinyuan Jia, Yuhao Liu, Rynson W. H. LauNeurIPS 2025 · 被引用 1 次
它引用的顶会 Paper30
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao 等ICCV 2023 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
相关 Paper
- MagicPaint: Operate Anything for Image Inpainting with Diffusion ModelQinhong Yang, Dongdong Chen, Qi Chu, Tao Gong 等AAAI 2026
- A Diffusion-Based Framework for Occluded Object MovementZheng-Peng Duan, Jiawei Zhang, Siyu Liu, Zheng Lin 等AAAI 2025 · 被引用 7 次
- CTRL&SHIFT: High-quality Geometry-Aware Object Manipulation in Visual GenerationPenghui Ruan, Bojia Zi, Xianbiao Qi, Youze Huang 等ICLR 2026 · 被引用 3 次
- RAA: Achieving Interactive Remove/Add Anything via Fully Synthetic DataDelong Liu, Haotian Hou, Zhaohui Hou, Shihao Han 等AAAI 2026
- Insert Anything: Image Insertion via In-Context Editing in DiTWensong Song, Hong Jiang, Zongxing Yang, Zheqiao Cheng 等AAAI 2026 · 被引用 1 次
