First Learn, Then Review: Human-Like Continual Learning for Cross-View Geo-Localization with Limited Field of View
Lei Cheng, Daikun Liu, Zhikun Chen, Teng Wang
Abstract
This paper addresses cross-view geo-localization in realworld scenarios, where the field-of-view (FoV) is restricted and the orientation is unknown for ground-view images. This task is extremely challenging due to the huge domain gap. Existing methods typically treat tasks with different FoVs as independent tasks. These approaches not only require separate retraining for each FoV, but also neglect the strong correlations between different FoVs, leading to poor performance under extremely limited FoV. To overcome these limitations, we propose HCL-Geo, a framework that follows human-like continual learning paradigm of "first learn, then review" for geo-localization: in the first "learn" stage, tasks are presented to the model in an easy-to-hard sequence to enable gradual learning and knowledge retention, so that their natural correlations could be exploited to facilitate knowledge transfer. In the second "review" stage, expert modules are incorporated to efficiently handle tasks with varying FoVs. This approach eliminates the need for retraining separate models and demonstrates state-of-the-art performance across different FoVs with strong generalization capabilities. Remarkably, the recall rate@top-1 improves from 49.1% to 68.3% and from 24.6% to 34.3% respectively on CVUSA and CVACT benchmarks with 70 • FoV.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on15
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer et al.CVPR 2022 · 6,782 citations
- Cross-view Geo-localization with Layer-to-Layer TransformerHongji Yang, Xiufan Lu, Yingying ZhuNeurIPS 2021 · 231 citations
- Optimal Feature Transport for Cross-View Image Geo-LocalizationYujiao Shi, Xin Yu, Liu Liu, Tong Zhang et al.AAAI 2020 · 210 citations
- Always Be Dreaming: A New Approach for Data-Free Class-Incremental LearningJames Seale Smith, Yen-Chang Hsu, Jonathan C. Balloch, Yilin Shen et al.ICCV 2021 · 208 citations
- TransGeo: Transformer Is All You Need for Cross-view Image Geo-localizationSijie Zhu, Mubarak Shah, Chen ChenCVPR 2022 · 189 citations
Related papers
- PLGeo: A Patch-level Framework to Overcome Orientation Discrepancies in Cross-view Geo-localizationYiru Li, Yingying ZhuACM MM 2025 · 1 citation
- SinGeo: Unlock Single Model's Potential for Robust Cross-View Geo-LocalizationYang Chen, Xieyuanli Chen, Junxiang Li, Jie Tang et al.CVPR 2026 · 1 citation
- Where Am I Looking At? Joint Location and Orientation Estimation by Cross-View MatchingYujiao Shi, Xin Yu, Dylan Campbell, Hongdong LiCVPR 2020
- Coming Down to Earth: Satellite-to-Street View Synthesis for Geo-LocalizationAysim Toker, Qunjie Zhou, Maxim Maximov, Laura Leal-TaixéCVPR 2021
- From Coarse to Fine: A Matching and Alignment Framework for Unsupervised Cross-View Geo-LocalizationXueyi Wang, Lele Zhang, Zheng Fan, Yang Liu et al.AAAI 2025 · 12 citations
