Pose-ICL: 3D-Aware In-Context Learning for Pose-Controllable Subject Customization
Xuan Han, Yihao Zhao, Mingyu You
摘要
Subject Customization is a foundational task in modern image generation. By providing a few reference images and a text prompt, users can generate images of a specific object in any desired scene. However, existing methods still struggle to achieve effective pose control for customized subjects. In practice, they often exhibit inaccurate poses or inconsistent cross-pose appearances. These limitations suggest that understanding objects in a volumetric manner remains a significant challenge for 2D-native backbones. To address this challenge, we propose Pose-ICL, a tuning-free framework that leverages 3D-aware In-Context Learning (ICL) to directly adapt to new subjects through multiple paired image-pose references. Its core mechanism, Surface-Anchored Position Embedding (SAPE), equips the model with explicit 3D awareness by anchoring image tokens to the surface coordinates of a volumetric bounding box. Dedicated refinements ensure its seamless compatibility with existing DiT models. Extensive evaluations on both 3D assets and real-world subjects demonstrate that Pose-ICL significantly outperforms current methods in both pose accuracy and identity consistency.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image SynthesisJunsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao 等ICLR 2024 · 被引用 831 次
- Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category ReconstructionJeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone 等ICCV 2021 · 被引用 686 次
相关 Paper
- IC-Custom: Diverse Image Customization via In-Context LearningYaowei Li, Xiaoyu Li, Zhaoyang Zhang, Yuxuan Bian 等ICLR 2026 · 被引用 10 次
- ViewWeaver: Geometry-Grounded Generative Rendering for 3D-Aware Image CustomizationYaowei Li, Xiaoyu Li, Zhaoyang Zhang, Hongxiang Li 等SIGGRAPH 2026
- Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context LearningXinshun Wang, Zhongbin Fang, Xia Li, Xiangtai Li 等CVPR 2024 · 被引用 12 次
- CAPE: Camera View Position Embedding for Multi-View 3D Object DetectionKaixin Xiong, Shi Gong, Xiaoqing Ye, Xiao Tan 等CVPR 2023
- CustomContrast: A Multilevel Contrastive Perspective for Subject-Driven Text-to-Image CustomizationNan Chen, Mengqi Huang, Zhuowei Chen, Yang Zheng 等AAAI 2025 · 被引用 9 次
