MPBR: Multimodal Progressive Bidirectional Reasoning for Open-Set Fine-Grained Recognition
Junfu Tan, Peiguang Jing, Yu Zhu, Yu Liu
摘要
Open-set fine-grained recognition (OSFGR) is the core exploration of building open-world intelligent systems. The challenge lies in the gradual semantic drift during the transition from coarse-grained to fine-grained categories. However, although existing methods leverage hierarchical representations to assist progressive reasoning, they neglect semantic consistency across hierarchies. To address this, we propose a multimodal progressive bidirectional reasoning framework: (1) In forward reasoning, the model progressively refines visual features to capture hierarchical structural representations, while (2) in backward reasoning, variational inference integrates multimodal information to constrain consistency in category-aware latent spaces. This mechanism mitigates semantic drift through bidirectional information flow and cross-hierarchical feature consistency constraints. Extensive experiments on the iNat2021-OSR dataset demonstrate that our proposed method achieves superior performance.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu 等ICCV 2021 · 被引用 31,683 次
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelLianghui Zhu, Bencheng Liao, Qian Zhang, Xinlong Wang 等ICML 2024 · 被引用 1,725 次
- Open-Set Recognition: A Good Closed-Set Classifier is All You NeedSagar Vaze, Kai Han, Andrea Vedaldi, Andrew ZissermanICLR 2022 · 被引用 594 次
- Conditional Variational Capsule Network for Open Set RecognitionYunrui Guo, Guglielmo Camporese, Wenjing Yang, Alessandro Sperduti 等ICCV 2021 · 被引用 58 次
相关 Paper
- From Coarse to Fine-Grained Open-Set RecognitionNico Lang, Vésteinn Snæbjarnarson, Elijah Cole, Oisin Mac Aodha 等CVPR 2024
- Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual UnderstandingJunhan Chen, Zilu Zhou, Yujun Tong, Dongliang Chang 等CVPR 2026 · 被引用 2 次
- iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement LearningChangbin Zhang, Yujie Zhong, Qiang Zhang, Kai HanICML 2026
- Consistency-aware Feature Learning for Hierarchical Fine-grained Visual ClassificationRui Wang, Cong Zou, Weizhong Zhang, Zixuan Zhu 等ACM MM 2023 · 被引用 6 次
- Hypergraph-guided Intra- and Inter-category Relation Modeling for Fine-grained Visual RecognitionLu Chen, Qiangchang Wang, Zhaohui Li, Yilong YinACM MM 2024 · 被引用 2 次
