OPRO: Orthogonal Panel-Relative Operators for Panel-Aware In-Context Image Generation
Sanghyeon Lee, Minwoo Lee, Euijin Shin, Kangyeol Kim, Seunghwan Choi, Jaegul Choo
Abstract
We introduce the Orthogonal Panel-Relative Operator (OPRO), a novel parameter-efficient adaptation method for tiled-panel In-Context Generation (ICG) that utilizes the pre-trained Diffusion Transformers (DiTs). OPRO works by composing learnable, panel-specific orthogonal operators onto the backbone's frozen positional encodings. This design provides two properties: 1) Isometry, which maintains feature geometry to promote stable fine-tuning, and 2) Same-Panel Invariance, which perfectly preserves the model's powerful pre-trained intra-panel synthesis capabilities. We conduct a controlled analysis demonstrating that OPRO's effectiveness is not limited to RoPE but consistently enhances performance across various positional encodings that satisfy orthogonality. By enabling effective panel-relative learning while simultaneously protecting the backbone's core synthesis power, OPRO consistently improves ICG-based instructional image editing methods, including state-of-the-art methods ICEdit.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c4a9de11-3844-46c3-a65f-3aacbefd5143Builds on17
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
Related papers
- Zero-Shot Adaptation of Parameter-Efficient Fine-Tuning in Diffusion ModelsFarzad Farhadzadeh, Debasmit Das, Shubhankar Borse, Fatih PorikliICML 2025
- Image Editing As Programs with Diffusion ModelsYujia Hu, Songhua Liu, Zhenxiong Tan, Xingyi Yang et al.NeurIPS 2025 · 10 citations
- FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image EditingTianyi Wei, Yifan Zhou, Dongdong Chen, Xingang PanICCV 2025
- CacheEdit: Efficient Multi-round Image Editing via Adaptive Token-wise Reuse.Jinxin Yu, Xueqing Chen, Yudong Pan, Lian Liu et al.ICML 2026
- RelationAdapter: Learning and Transferring Visual Relation with Diffusion TransformersYan Gong, Yiren Song, Yicheng Li, Chenglin Li et al.NeurIPS 2025 · 30 citations
