arXiv Computer Vision
Sep 11

SPECTRA: Band-Routed Embedding and Stage-Wise LoRA for Cross-Sensor Fine-Tuning of Geospatial Foundation Models

SPECTRA is a parameter‑efficient fine‑tuning framework for geospatial foundation models that tackles two key challenges: spectral mismatch and high adaptation cost. It introduces Band‑Routed Embedding (BRE) to map downstream sensor bands into the pretrained model’s expected band space, enabling full use of available spectral data without altering the patch embedding interface. Additionally, Stage‑wise Transferability‑aware LoRA (ST‑LoRA) estimates stage‑wise transferability and assigns LoRA ranks accordingly, concentrating trainable parameters on the most transferable stages and reducing overall adaptation cost.

By Xingyan Li, Jordan A. Caraballo-Vega, Jie Gong, Mark L. Carroll, Jianwu Wang
arXiv Computer Vision
1d ago

Cryo-Bench: Benchmarking Foundation Models for Cryosphere Mapping

Cryo-Bench is a new benchmark that evaluates foundation models for cryosphere mapping, comprising six semantic‑segmentation datasets across five cryospheric components (supraglacial debris, glacial lakes, sea ice, calving fronts, and Antarctic ice‑shelf extent). The benchmark includes multispectral, RGB, and SAR observations from under‑represented regions and tests thirteen geo‑foundation models alongside U‑Net and Vision Transformer baselines. Results show that with frozen encoders U‑Net slightly outperforms TerraMind, but the difference is not statistically significant; fine‑tuning with learning‑rate optimization can dramatically improve performance for some models, while in few‑shot scenarios several foundation models retain over 90 % of their full‑label accuracy.

By Saurabh Kaushik, Lalit Maurya, Beth Tellman, Swalpa Kumar Roy, Valerio Marsocci, Gustau Camps-Valls, Jocelyn Chanussot