Remedying Target-Domain Astigmatism for Cross-Domain Few-Shot Object Detection
Yongwei Jiang, Yixiong Zou, Yuhua Li, Ruixuan Li
Abstract
Cross-domain few-shot object detection (CD-FSOD) aims to adapt pretrained detectors from a source domain to target domains with limited annotations, suffering from severe domain shifts and data scarcity problems. In this work, we find a previously overlooked phenomenon: models exhibit dispersed and unfocused attention in target domains, leading to imprecise localization and redundant predictions, just like a human cannot focus on visual objects. Therefore, we call it the target-domain Astigmatism problem. Analysis on attention distances across transformer layers reveals that regular fine-tuning inherently shows a trend to remedy this problem, but results are still far from satisfactory, which we aim to enhance in this paper. Biologically inspired by the human fovea-style visual system, we enhance the fine-tuning's inherent trend through a center-periphery attention refinement framework, which contains (1) a Positive Pattern Refinement module to reshape attention toward semantic objects using class-specific prototypes, simulating the visual center region; (2) a Negative Context Modulation module to enhance boundary discrimination by modeling background context, simulating the visual periphery region; and (3) a Textual Semantic Alignment module to strengthen center-periphery distinction through cross-modal cues. Our bio-inspired approach transforms astigmatic attention into focused patterns, substantially improving adaptation to target domains. Experiments on six challenging CD-FSOD benchmarks consistently demonstrate improved detection accuracy and establish new state-of-the-art results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ba937e75-de2b-4691-9dda-e034aacea025Builds on19
- Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting MitigationYixiong Zou, Shanghang Zhang, Yuhua Li, Ruixuan LiNeurIPS 2022 · 100 citations
- Underwater Species Detection using Channel Sharpening AttentionLihao Jiang, Yi Wang, Qi Jia, Shengwei Xu et al.ACM MM 2021 · 86 citations
- A Closer Look at the CLS Token for Cross-Domain Few-Shot LearningYixiong Zou, Shuai Yi, Yuhua Li, Ruixuan LiNeurIPS 2024 · 40 citations
- Attention Temperature Matters in ViT-Based Cross-Domain Few-Shot LearningYixiong Zou, Ran Ma, Yuhua Li, Ruixuan LiNeurIPS 2024 · 35 citations
- Compositional Few-Shot Class-Incremental LearningYixiong Zou, Shanghang Zhang, Haichen Zhou, Yuhua Li et al.ICML 2024 · 31 citations
Related papers
- AsyFOD: An Asymmetric Adaptation Paradigm for Few-Shot Domain Adaptive Object DetectionYipeng Gao, Kun-Yu Lin, Junkai Yan, Yaowei Wang et al.CVPR 2023
- Less Is Better: Sparse Instance Learning for Cross-Domain Few-Shot Object DetectionYali Huang, Jie Mei, Ziyi Wu, Yiming Yang et al.AAAI 2026
- Cross-domain Object Detection through Coarse-to-Fine Feature AdaptationYangtao Zheng, Di Huang, Songtao Liu, Yunhong WangCVPR 2020
- StyleProto: Style-Augmented Prototype Learning for Cross-Domain Few-Shot Object DetectionXi Yang, Quantao XieAAAI 2026
- Context-Transformer: Tackling Object Confusion for Few-Shot DetectionZe Yang, Yali Wang, Xianyu Chen, Jianzhuang Liu et al.AAAI 2020 · 91 citations
