Omni2: Unifying Omnidirectional Image Generation and Editing in an Omni Model
Liu Yang, Huiyu Duan, Yucheng Zhu, Xiaohong Liu, Lu Liu, Zitong Xu, Guangji Ma, Xiongkuo Min, Guangtao Zhai, Patrick Le Callet
摘要
360° omnidirectional images (ODIs) have gained considerable attention recently, and are widely used in various virtual reality (VR) and augmented reality (AR) applications. However, capturing such images is expensive and requires specialized equipment, making ODI synthesis increasingly important. While common 2D image generation and editing methods are rapidly advancing, these models struggle to deliver satisfactory results when generating or editing ODIs due to the unique format and broad 360° Field-of-View (FoV) of ODIs. To bridge this gap, we construct Any2Omni , the first comprehensive ODI generation-editing dataset comprises 60,000+ training data covering diverse input conditions and up to 9 ODI generation and editing tasks. Built upon Any2Omni, we propose an Omni model for Omni-directional image generation and editing ( Omni 2), with the capability of handling various ODI generation and editing tasks under diverse input conditions using one model. Extensive experiments demonstrate the superiority and effectiveness of the proposed Omni2 model for both the ODI generation and editing tasks. Both the Any2Omni dataset and the Omni2 model are publicly available at: https://github.com/IntMeGroup/Omni2.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal ModelsYushuo Zheng, Jiangyong Ying, Huiyu Duan, Chunyi Li 等AAAI 2026 · 被引用 2 次
- B-Spar: Bayesian Sparse-Reward Modeling for RL-based Image Editingshusong xu, Peiye Liu, Yongbin Liu, Bangjie Yin 等ICML 2026
- World-Shaper: A Unified Framework for 360° Panoramic EditingDong Liang, yuhao liu, Jinyuan Jia, Youjun Zhao 等ICML 2026
它引用的顶会 Paper31
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann 等ICLR 2024 · 被引用 4,569 次
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng 等NeurIPS 2024 · 被引用 1,199 次
相关 Paper
- ODI-Bench: Can MLLMs Understand Immersive Omnidirectional Environments?Liu Yang, Huiyu Duan, Ran Tao, Juntao Cheng 等ICLR 2026 · 被引用 13 次
- OmniStitch: Depth-Aware Stitching Framework for Omnidirectional Vision with Multiple CamerasSooho Kim, Soyeon Hong, Kyungsoo Park, Hyunsouk Cho 等ACM MM 2024 · 被引用 6 次
- Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image GenerationZhuqiang Lu, Kun Hu, Chaoyue Wang, Lei Bai 等AAAI 2024 · 被引用 35 次
- HELVIPAD: A Real-World Dataset for Omnidirectional Stereo Depth EstimationMehdi Zayene, Jannik Endres, Albias Havolli, Charles Corbière 等CVPR 2025
- Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and EditingZeyue Tian, Binxin Yang, Zhaoyang Liu, Jiexuan Zhang 等SIGGRAPH 2026
