Parallax to Align Them All: An OmniParallax Attention Mechanism for Distributed Multi-View Image Compression
Haotian Zhang, Feiyue Long, Yixin Yu, Jian Xue, Haocheng Tang, Tongda Xu, Zhenning Shi, Yan Wang, Siwei Ma, Jiaqi Zhang
摘要
Multi-view image compression (MIC) aims to achieve high compression efficiency by exploiting inter-image correlations, playing a crucial role in 3D applications. As a subfield of MIC, distributed multi-view image compression (DMIC) offers performance comparable to MIC while eliminating the need for inter-view information at the encoder side. However, existing methods in DMIC typically treat all images equally, overlooking the varying degrees of correlation between different views during decoding, which leads to suboptimal coding performance. To address this limitation, we propose a novel (OPAM), which is a general mechanism for explicitly modeling correlations and aligned features between arbitrary pairs of information sources. Building upon OPAM, we propose a Parallax Multi Information Fusion Module (PMIFM) to adaptively integrate information from different sources. PMIFM is incorporated into both the joint decoder and the entropy model to construct our end-to-end DMIC framework, . Extensive experiments demonstrate that is to significantly surpass state-of-the-art MIC codecs, while maintaining low computational overhead. Performance gains become more pronounced as the number of input views increases. Compared with LDMIC, achieves bitrate savings of \textbf{19.72%} on WildTrack(3) and up to \textbf{24.18%} on WildTrack(6), while significantly improving coding efficiency (as much as in decoding and in encoding).
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan 等CVPR 2022 · 被引用 1,603 次
- DSIC: Deep Stereo Image CompressionJerry Liu, Shenlong Wang, Raquel UrtasunICCV 2019 · 被引用 50 次
- SASIC: Stereo Image Compression with Latent Shifts and Stereo AttentionMatthias Wödlinger, Jan Kotera, Jan Xu, Robert SablatnigCVPR 2022 · 被引用 24 次
- Deep Stereo Image Compression via Bi-directional CodingJianjun Lei, Xiangrui Liu, Bo Peng, Dengchao Jin 等CVPR 2022 · 被引用 18 次
- Learned Distributed Image Compression with Multi-Scale Patch Matching in Feature DomainYujun Huang, Bin Chen, Shiyu Qin, Jiawei Li 等AAAI 2023 · 被引用 11 次
相关 Paper
- LDMIC: Learning-based Distributed Multi-view Image CodingXinjie Zhang, Jiawei Shao, Jun ZhangICLR 2023 · 被引用 2 次
- Unveiling Multi-View Anomaly Detection: Intra-view Decoupling and Inter-view FusionKai Mao, Yiyang Lian, Yangyang Wang, Meiqin Liu 等AAAI 2025 · 被引用 4 次
- Distributed Image Compression with Multimodal Side Information at Extremely Low BitratesGuojun Xu, Mingyang Zhang, Jianwen Xiang, Cheng Tan 等CVPR 2026
- Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and SegmentationJinyuan Liu, Zhu Liu, Guanyao Wu, Long Ma 等ICCV 2023 · 被引用 287 次
- Global-Semantic Alignment Distillation for Partial Multi-view ClassificationXiaoli Wang, Anqi Huang, Yongli Wang, Guanzhou Ke 等AAAI 2025 · 被引用 2 次
