ViewWeaver: Geometry-Grounded Generative Rendering for 3D-Aware Image Customization
Yaowei Li, Xiaoyu Li, Zhaoyang Zhang, Hongxiang Li, Long Chen, Ying Shan, Yuexian Zou
Abstract
Image customization is a fundamental image editing task that synthesizes an instruction-following image of a specific subject conditioned on reference images. However, most existing methods rely on a single reference image, which makes it difficult to preserve the subject’s underlying 3D structure and maintain multi-view consistency. We therefore study 3D-aware image customization: given an arbitrary multi-view reference set, the model generates an instruction-following image from a user-specified target camera viewpoint, while preserving both subject identity and 3D geometry. This formulation enables a practical “capture-then-customize” workflow and reduces the viewpoint drift commonly observed in 2D-conditioned editors. We propose ViewWeaver, a geometry-grounded generative rendering framework that anchors synthesis with explicit target-view rendering cues aligned with camera geometry, and aggregates multi-view evidence through a lightweight Mixture-of-Views module inside a rectified-flow DiT generator. To facilitate scalable training and systematic evaluation, we build a large-scale data engine and introduce GSO12, a comprehensive benchmark assessing visual fidelity, instruction adherence, and 3D consistency across different reference-view budgets and diverse scene contexts. Extensive experiments show that ViewWeaver significantly improves 3D consistency and viewpoint controllability while maintaining strong identity preservation, enabling accurate and flexible view-controllable customization.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 42b69fb2-af3b-4979-a374-763583ced8beRelated papers
- MVCustom: Multi-View Customized Diffusion via Geometric Latent Rendering and CompletionMinjung Shin, Hyunin Cho, Sooyeon Go, Jin-Hwa Kim et al.ICLR 2026 · 3 citations
- Ray Conditioning: Trading Photo-consistency for Photo-realism in Multi-view Image GenerationEric Ming Chen, Sidhanth Holalkere, Ruyu Yan, Kai Zhang et al.ICCV 2023 · 11 citations
- GeoDiffusion: A Training-Free Framework for Accurate 3D Geometric Conditioning in Image GenerationPhillip Mueller, Talip Uenlue, Sebastian Schmidt, Marcel Kollovieh et al.ICCV 2025 · 2 citations
- Edit360: 2D Image Edits to 3D Assets From Any AngleJunchao Huang, Xinting Hu, Shaoshuai Shi, Zhuotao Tian et al.ICCV 2025 · 2 citations
- 3DOT: Texture Transfer for 3DGS Objects from a Single Reference ImageXiao Cao, Beibei Lin, Bo Wang, Zhiyong Huang et al.NeurIPS 2025 · 8 citations
