Beyond Unidirectional Bias: Reciprocal Perspective Calibration in Scene Graph Generation
Haifeng Zhao, Wenbo Zhao, Xuemei Luo, Lei-Lei Ma, Dengdi Sun
Abstract
Scene Graph Generation (SGG) paradigms predominantly model relationships as static, unidirectional mappings (), effectively treating objects as passive recipients of actions. This formulation suffers from an inherent unidirectional bias, violating the physical reality that visual interactions are intrinsically reciprocal. Consequently, existing models often fail to maintain logical self-consistency when the reasoning anchor shifts from the subject to the object. To rectify this cognitive deficiency, we establish the Mutual-Perspective Inverse Relations (MPIR) principle, positing that a robust visual representation must satisfy logical consistency across dual perspectives. Guided by this principle, we propose the Reciprocal Perspective Calibration (RPC) framework, a model-agnostic framework that operationalizes MPIR via a novel Adaptive Inverse-Relation Augmentation (AIRA) strategy. Furthermore, we introduce Hypernym-Guided Prompts (HGP) to bridge the gap between semantic context and computational efficiency in vision-language models, enabling precise modeling of inverse relations. Extensive experiments demonstrate that RPC not only achieves competitive performance on standard benchmarks but also significantly enhances the model's capability to understand inverse relations, as verified by a new inverse consistency evaluation protocol, demonstrating the cognitive robustness of our method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 70588382-ee3c-4e68-91b2-38f67b8cace1Builds on14
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Conditional Prompt Learning for Vision-Language ModelsKaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei LiuCVPR 2022 · 1,438 citations
- Spatial-Temporal Transformer for Dynamic Scene Graph GenerationYuren Cong, Wentong Liao, Hanno Ackermann, Bodo Rosenhahn et al.ICCV 2021 · 163 citations
- Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph GenerationXingning Dong, Tian Gan, Xuemeng Song, Jianlong Wu et al.CVPR 2022 · 116 citations
- Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open WorldQifan Yu, Juncheng Li, Yu Wu, Siliang Tang et al.ICCV 2023 · 51 citations
Related papers
- HSGG: Training-Free Hierarchical Scene Graph Generation with Geometry-Guided Relation Reasoningyunzhe Liu, Wenbiao Liu, Lihui Cen, Zhe Qu et al.ICML 2026
- APT: Towards Universal Scene Graph Generation via Plug-in Adaptive Prompt TuningRuikun Luo, Changwei Gu, Jing Yang, Yuan Gao et al.ICLR 2026
- Open-World 3D Scene Graph Generation for Retrieval-Augmented ReasoningFei Yu, Quan Deng, Shengeng Tang, Yuehua Li et al.AAAI 2026 · 2 citations
- Relation-aware Hierarchical Prompt for Open-vocabulary Scene Graph GenerationTao Liu, Rongjie Li, Chongyu Wang, Xuming HeAAAI 2025
- Vision-Language Interactive Relation Mining for Open-Vocabulary Scene Graph GenerationYukuan Min, Muli Yang, Jinhao Zhang, Yuxuan Wang et al.ICCV 2025 · 2 citations
