OPRO: Orthogonal Panel-Relative Operators for Panel-Aware In-Context Image Generation
Sanghyeon Lee, Minwoo Lee, Euijin Shin, Kangyeol Kim, Seunghwan Choi, Jaegul Choo
摘要
We introduce the Orthogonal Panel-Relative Operator (OPRO), a novel parameter-efficient adaptation method for tiled-panel In-Context Generation (ICG) that utilizes the pre-trained Diffusion Transformers (DiTs). OPRO works by composing learnable, panel-specific orthogonal operators onto the backbone's frozen positional encodings. This design provides two properties: 1) Isometry, which maintains feature geometry to promote stable fine-tuning, and 2) Same-Panel Invariance, which perfectly preserves the model's powerful pre-trained intra-panel synthesis capabilities. We conduct a controlled analysis demonstrating that OPRO's effectiveness is not limited to RoPE but consistently enhances performance across various positional encodings that satisfy orthogonality. By enabling effective panel-relative learning while simultaneously protecting the backbone's core synthesis power, OPRO consistently improves ICG-based instructional image editing methods, including state-of-the-art methods ICEdit.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 被引用 6,759 次
相关 Paper
- Zero-Shot Adaptation of Parameter-Efficient Fine-Tuning in Diffusion ModelsFarzad Farhadzadeh, Debasmit Das, Shubhankar Borse, Fatih PorikliICML 2025
- Image Editing As Programs with Diffusion ModelsYujia Hu, Songhua Liu, Zhenxiong Tan, Xingyi Yang 等NeurIPS 2025 · 被引用 10 次
- FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image EditingTianyi Wei, Yifan Zhou, Dongdong Chen, Xingang PanICCV 2025
- CacheEdit: Efficient Multi-round Image Editing via Adaptive Token-wise Reuse.Jinxin Yu, Xueqing Chen, Yudong Pan, Lian Liu 等ICML 2026
- RelationAdapter: Learning and Transferring Visual Relation with Diffusion TransformersYan Gong, Yiren Song, Yicheng Li, Chenglin Li 等NeurIPS 2025 · 被引用 30 次
