Remedying Target-Domain Astigmatism for Cross-Domain Few-Shot Object Detection
Yongwei Jiang, Yixiong Zou, Yuhua Li, Ruixuan Li
摘要
Cross-domain few-shot object detection (CD-FSOD) aims to adapt pretrained detectors from a source domain to target domains with limited annotations, suffering from severe domain shifts and data scarcity problems. In this work, we find a previously overlooked phenomenon: models exhibit dispersed and unfocused attention in target domains, leading to imprecise localization and redundant predictions, just like a human cannot focus on visual objects. Therefore, we call it the target-domain Astigmatism problem. Analysis on attention distances across transformer layers reveals that regular fine-tuning inherently shows a trend to remedy this problem, but results are still far from satisfactory, which we aim to enhance in this paper. Biologically inspired by the human fovea-style visual system, we enhance the fine-tuning's inherent trend through a center-periphery attention refinement framework, which contains (1) a Positive Pattern Refinement module to reshape attention toward semantic objects using class-specific prototypes, simulating the visual center region; (2) a Negative Context Modulation module to enhance boundary discrimination by modeling background context, simulating the visual periphery region; and (3) a Textual Semantic Alignment module to strengthen center-periphery distinction through cross-modal cues. Our bio-inspired approach transforms astigmatic attention into focused patterns, substantially improving adaptation to target domains. Experiments on six challenging CD-FSOD benchmarks consistently demonstrate improved detection accuracy and establish new state-of-the-art results.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting MitigationYixiong Zou, Shanghang Zhang, Yuhua Li, Ruixuan LiNeurIPS 2022 · 被引用 100 次
- Underwater Species Detection using Channel Sharpening AttentionLihao Jiang, Yi Wang, Qi Jia, Shengwei Xu 等ACM MM 2021 · 被引用 86 次
- A Closer Look at the CLS Token for Cross-Domain Few-Shot LearningYixiong Zou, Shuai Yi, Yuhua Li, Ruixuan LiNeurIPS 2024 · 被引用 40 次
- Attention Temperature Matters in ViT-Based Cross-Domain Few-Shot LearningYixiong Zou, Ran Ma, Yuhua Li, Ruixuan LiNeurIPS 2024 · 被引用 35 次
- Compositional Few-Shot Class-Incremental LearningYixiong Zou, Shanghang Zhang, Haichen Zhou, Yuhua Li 等ICML 2024 · 被引用 31 次
相关 Paper
- AsyFOD: An Asymmetric Adaptation Paradigm for Few-Shot Domain Adaptive Object DetectionYipeng Gao, Kun-Yu Lin, Junkai Yan, Yaowei Wang 等CVPR 2023
- Less Is Better: Sparse Instance Learning for Cross-Domain Few-Shot Object DetectionYali Huang, Jie Mei, Ziyi Wu, Yiming Yang 等AAAI 2026
- Cross-domain Object Detection through Coarse-to-Fine Feature AdaptationYangtao Zheng, Di Huang, Songtao Liu, Yunhong WangCVPR 2020
- StyleProto: Style-Augmented Prototype Learning for Cross-Domain Few-Shot Object DetectionXi Yang, Quantao XieAAAI 2026
- Context-Transformer: Tackling Object Confusion for Few-Shot DetectionZe Yang, Yali Wang, Xianyu Chen, Jianzhuang Liu 等AAAI 2020 · 被引用 91 次
