DyFCLT: Dynamic Frequency-Decoupled Cross-Modal Learning Transformer for Multimodal Tiny Object Detection
Chaolang Li, Pengwen Dai, Jingyu Li, Siyuan Yao, Yuchen Jiang, Zhuoran Zheng
Abstract
Multimodal tiny object detection plays a critical role in real-world applications. However, detecting tiny objects remains challenging due to environmental complexities. While recent methods leverage spatial multi-scale representations or frequency-domain enhancements, most focus solely on visible images and overlook complementary multimodal frequency cues. This paper explores how to effectively harness cross-modal frequency information for infrared–visible tiny object detection. Through frequency characteristic analysis, we observe that tiny objects exhibit rich mid- and high-frequency energy across both modalities, motivating the design of a Dynamic Frequency-decoupled Cross-modal Learning Transformer (DyFCLT). Our approach introduces a Dynamic Frequency-Band Decoupled Cross-Modal Attention (DFCA) mechanism to extract and interact frequency components across modalities. To suppress noise while enhancing foreground signals, a Selective Smoothing Enhancement (SSE) strategy is proposed, which smoothes background interference and guides multi-scale feature fusion. DFCA and SSE collaborate to achieve synergistic enrichment and refinement of cross-modal features. Extensive experiments on two tiny-object benchmarks and one general-scale benchmark demonstrate that DyFCLT sets new state-of-the-art results, outperforming prior leading methods by significant margins and exhibiting strong generalization across scales and scenarios.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 705835ed-1786-4fb8-baad-be55f1d42ab7Builds on26
- Deformable DETR: Deformable Transformers for End-to-End Object DetectionXizhou Zhu, Weijie Su, Lewei Lu, Bin Li et al.ICLR 2021 · 7,353 citations
- FCOS: Fully Convolutional One-Stage Object DetectionZhi Tian, Chunhua Shen, Hao Chen, Tong HeICCV 2019 · 6,042 citations
- DETRs Beat YOLOs on Real-time Object DetectionYian Zhao, Wenyu Lv, Shangliang Xu, Jinman Wei et al.CVPR 2024 · 3,046 citations
- Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object DetectionXiang Li, Wenhai Wang, Lijun Wu, Shuo Chen et al.NeurIPS 2020 · 2,118 citations
- DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object DetectionHao Zhang, Feng Li, Shilong Liu, Lei Zhang et al.ICLR 2023 · 753 citations
Related papers
- SET: Spectral Enhancement for Tiny Object DetectionHuixin Sun, Runqi Wang, Yanjing Li, Linlin Yang et al.CVPR 2025
- FD2-Net: Frequency-Driven Feature Decomposition Network for Infrared-Visible Object DetectionKe Li, Di Wang, Zhangyuan Hu, Shaofeng Li et al.AAAI 2025 · 19 citations
- SeViL: Semi-supervised Vision-Language Learning with Text Prompt Guiding for Moving Infrared Small Target DetectionWeiwei Duan, Luping Ji, Jianghong Huang, Sicheng ZhuAAAI 2026
- Spatial-Frequency Mamba Collaborative Learning Network for Infrared Small Target DetectionYongji Li, Luping WangACM MM 2025 · 1 citation
- TIRDet: Mono-Modality Thermal InfraRed Object Detection Based on Prior Thermal-To-Visible TranslationZeyu Wang, Fabien Colonnier, Jinghong Zheng, Jyotibdha Acharya et al.ACM MM 2023 · 28 citations
