← Back to all news
arXiv Machine Learning By Ken Chen, Maneesha Perera, Wei Wang, Sachith Seneviratne, Hansani Weeratunge, Saman Halgamuge

Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models

Read the original on arXiv Machine Learning →

The paper introduces SolCloudLLM, a large language model–based framework that fuses sky‑image patches with time‑series data through bidirectional multimodal fusion for short‑term solar forecasting. Experiments on the SIRTA and SKIPP'D datasets show that SolCloudLLM outperforms existing baselines, achieving up to a 25.4% reduction in mean squared error, especially under cloudy conditions and in few‑shot scenarios.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv Machine Learning
6d ago

SolarBench: A global solar energy nowcasting benchmark

SolarBench is an open global benchmark for image-based solar nowcasting that consolidates over six million sky and satellite images from 11 sites across a decade, paired with irradiance, PV output, and atmospheric data. The benchmark includes a toolbox for reproducible data access, processing, model development, and evaluation. Using SolarBench, the authors benchmark representative models, uncover a gap between average forecasting accuracy and the capture of rapid solar fluctuations, quantify predictability across cloud regimes, and demonstrate data‑efficient adaptation to new PV systems.

By Yuhao Nie, Stephen Campbell, Quentin Paletta, Liwenbo Zhang, Tao Jing, Samer Chaaraoui, Jonathan Giezendanner, Andea Scott, Tao Sun, Cong Feng, Max Aragon, Jacques Camier, Adam Jensen, Florian Kotthoff, Yuexing Yang, Yang Ming, Mengying Li, Stefanie Meilinger, Yupeng Wu, Adam Brandt, Sherrie Wang
benchmarks
More like this →
arXiv Machine Learning
Sep 4

From Nowcasting to Forecasting: Adapting a Reanalysis-Trained

The paper introduces CloudCast v2, a machine‑learning model that forecasts 12‑hour cloud‑cover from satellite‑derived initial conditions. Trained first on the Copernicus European Regional Reanalysis to learn cloud‑evolution dynamics, it is then adapted to real satellite data using conditional flow matching, a generative technique that conditions noise on observed cloud fields and NWP inputs. CloudCast v2 achieves a 10 % reduction in mean absolute error compared to its predecessor and surpasses it in spatial skill after 3–6 hours, extending useful forecasting beyond the typical 1–3‑hour nowcasting window while preserving satellite‑level spatial detail.

By Mikko Partio, Leila Hieta, Ossi Laine
diffusion
More like this →