Domain-Informed Multi-View Self-Distillation for Astronomical Light-Curve Representation Learning with JEPA
arXiv:2606. 28446v1 Announce Type: cross Abstract: Light curves describe temporal variations in the brightness of celestial objects.
arXiv:2604. 09787v2 Announce Type: replace-cross Abstract: Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument.
arXiv:2606. 28446v1 Announce Type: cross Abstract: Light curves describe temporal variations in the brightness of celestial objects.
arXiv:2606. 11190v1 Announce Type: new Abstract: Cross-modal alignment (CA) and cross-modal prediction (CP) are the dominant paradigms for multimodal representation learning, yet there is no systematic understanding of when each succeeds, when each fails, and when cross-modal training helps at all -- a gap that leaves practitioners, especially in scientific domains like biomedicine or astrophysics, with heterogeneous instruments and multiple levels of organization and measurement, unable to diagnose why standard methods underperform the best single modality.
Cross-modal alignment (CA) and cross-modal prediction (CP) are the dominant paradigms for multimodal representation learning, yet there is no systematic understanding of when each succeeds, when each fails, and when cross-modal training helps at all -- a gap that leaves practitioners, especially in scientific domains like biomedicine or astrophysics, with heterogeneous instruments and multiple levels of organization and measurement, unable to diagnose why standard methods underperform the best single modality. We develop a unified linear framework that addresses both questions.
The paper demonstrates that a self‑supervised Vision Transformer (ViT) pretrained on a fast, low‑cost semi‑numerical simulator can produce data summaries that transfer across different simulators without retraining. In 21cm cosmology, the ViT—named SKATR—pretrained on 67,000 21cmFAST lightcones is applied unchanged to hydrodynamical Loreli II lightcones, enabling accurate inference of five astrophysical parameters with fewer radiative‑transfer simulations than a fully‑supervised baseline. SKATR remains accurate, informative, and calibrated even under realistic SKA antenna array noise, outperforming supervised models retrained on noisy data.
arXiv:2602. 10330v3 Announce Type: replace-cross Abstract: Context: The characterization of exoplanetary atmospheres has been transformed by the James Webb Space Telescope (JWST), whose infrared sensitivity enables transmission spectroscopy at unprecedented precision.
arXiv:2609.13272v1 Announce Type: cross Abstract: Gravitational-wave denoising must handle the full diversity of spinning, precessing binaries, since the recovered waveform underpins parameter estima...
arXiv:2607. 03644v1 Announce Type: cross Abstract: Decades of orbital missions have produced multi-modal remote sensing data for the Moon, spanning optical imagery, spectroscopy, thermal emission, radar, gravity, and elemental composition.
arXiv:2503. 22223v2 Announce Type: replace Abstract: The semi-airborne transient electromagnetic method (SATEM) is capable of conducting rapid surveys over large-scale and hard-to-reach areas.
arXiv:2507. 03094v2 Announce Type: replace-cross Abstract: Many challenges in scientific imaging involve solving ill-posed inverse problems, where the goal is to recover spatio-temporal fields from indirect, noisy, and highly sparse measurements - often without access to ground truth data or reliable simulators.
arXiv:2408. 15344v2 Announce Type: replace Abstract: Many scientific and engineering problems involve observing a common phenomenon through multiple heterogeneous sensors or measurement modalities.
SlowFast‑SCI introduces a dual‑speed deep‑unfolding framework for spectral compressive imaging that combines a slow, pre‑trained backbone with a fast, test‑time adaptation stage. The slow phase distills a priors‑based model into a compact fast‑unfolding network, while the fast phase embeds lightweight modules that self‑supervise at test time without retraining the backbone. This design yields significant reductions in parameters and FLOPs, improves out‑of‑distribution PSNR by up to 5.79 dB, and accelerates adaptation four‑fold, all while remaining modular enough to integrate with any existing deep‑unfolding system.
arXiv:2606. 10197v1 Announce Type: cross Abstract: Integral field unit (IFU) spectroscopy provides spatially resolved spectra across galaxies, offering crucial insights into their evolution.