arXiv Machine Learning

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models

arXiv:2509. 22020v2 Announce Type: replace Abstract: While recent advances in machine learning have equipped Weather Foundation Models (WFMs) with substantial generalization capabilities across diverse downstream tasks, the escalating computational requirements associated with their expanding scale increasingly hinder practical deployment.

arXiv Computer Vision
Aug 24

ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation

ES‑VP introduces Energy‑Shaped Visual Prompting, a method that generates image‑specific prompts through low‑rank initialization and energy‑guided dynamic adaptation. It achieves higher performance than existing single‑prompt and diverse‑prompt approaches while using far fewer parameters. Experiments on five architectures and fifteen datasets show consistent superiority, including a 2.6% accuracy gain over DAM‑VP on CLIP with 590× fewer prompt parameters.

By Can Jin, Ying Li, Jingchen Sun, Hongwu Peng, Jiahui Zhao, Yang Zhou, Lei Li, Dimitris N. Metaxas
arXiv Machine Learning
Aug 27

Precipitation Downscaling Using Foundation Model-Conditioned Diffusion

The study evaluates three conditioning strategies for a denoising diffusion probabilistic model to downscale daily precipitation for the Colorado River Basin. Channel concatenation of upsampled coarse predictors yields the lowest point‑wise CRPS and MSE but tends to over‑smooth high‑intensity events. Cross‑attention conditioning—both with a learned encoder and with the frozen encoder of the pretrained Prithvi‑WxC weather foundation model—provides better distributional realism, improved spectral fidelity, and stronger performance on extreme events, especially when data are limited.

By Victor Nascimento Ribeiro, Jorge Guevara, Jorge Sebastian Moraga, Chris Lucas, Natalie Lord, Andrew Taylor, Edward Lockhart, Will Trojak, Johannes Schmude, Anne Jones