TerraFM: A Scalable Foundation Model for Unified Multisensor Earth Observation
Muhammad Sohail Danish, Muhammad Akhtar Munir, Syed Roshaan Ali Shah, Muhammad Haris Khan, Rao Muhammad Anwer, Jorma Laaksonen, Fahad Shahbaz Khan, Salman Khan
摘要
Modern Earth observation (EO) increasingly leverages deep learning to harness the scale and diversity of satellite imagery across sensors and regions. While recent foundation models have demonstrated promising generalization across EO tasks, many remain limited by the scale, geographical coverage, and spectral diversity of their training data, factors critical for learning globally transferable representations. In this work, we introduce TerraFM, a scalable self-supervised learning model that leverages globally distributed Sentinel-1 and Sentinel-2 imagery, combined with large spatial tiles and land-cover aware sampling to enrich spatial and semantic coverage. By treating sensing modalities as natural augmentations in our self-supervised approach, we unify radar and optical inputs via modality-specific patch embeddings and adaptive cross-attention fusion. Our training strategy integrates local-global contrastive learning and introduces a dual-centering mechanism that incorporates class-frequency-aware regularization to address long-tailed distributions in land cover. TerraFM achieves strong generalization on both classification and segmentation tasks, outperforming prior models on GEO-Bench and Copernicus-Bench. Our code and pretrained models are publicly available at https://github.com/mbzuai-oryx/TerraFM .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper3
- PRUE: A Practical Recipe for Field Boundary Segmentation at ScaleGedeon Muhawenayo, Caleb Robinson, Subash Khanal, Zhanpei Fang 等CVPR 2026 · 被引用 7 次
- Brewing Stronger Features: Dual-Teacher Distillation for Multispectral Earth ObservationFilip Wolf, Blaz Rolih, Luka Cehovin ZajcCVPR 2026 · 被引用 4 次
- GeoSANE: Learning Geospatial Representations from Models, Not DataJoëlle Hanna, Damian Falk, Stella X. Yu, Damian BorthCVPR 2026 · 被引用 1 次
它引用的顶会 Paper15
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn 等ICLR 2021 · 被引用 21,477 次
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou 等ICCV 2021 · 被引用 8,921 次
- Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation LearningColorado J. Reed, Ritwik Gupta, Shufan Li, Sarah Brockman 等ICCV 2023 · 被引用 373 次
- CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked AutoencodersAnthony Fuller, Koreen Millard, James R. GreenNeurIPS 2023 · 被引用 245 次
- SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image UnderstandingFavyen Bastani, Piper Wolters, Ritwik Gupta, Joe Ferdinando 等ICCV 2023 · 被引用 216 次
相关 Paper
- Galileo: Learning Global & Local Features of Many Remote Sensing ModalitiesGabriel Tseng, Anthony Fuller, Marlena Reil, Henry Herzog 等ICML 2025
- SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation ImageryXin Guo, Jiangwei Lao, Bo Dang, Yingying Zhang 等CVPR 2024
- TerraMind: Large-Scale Generative Multimodality for Earth ObservationJohannes Jakubik, Felix Yang, Benedikt Blumenstiel, Erik Scheurer 等ICCV 2025 · 被引用 43 次
- Towards a Unified Copernicus Foundation Model for Earth VisionYi Wang, Zhitong Xiong, Chenying Liu, Adam J. Stewart 等ICCV 2025 · 被引用 7 次
- Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?Yuru Jia, Valerio Marsocci, Ziyang Gong, Xue Yang 等ICCV 2025
