arXiv Machine Learning

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference

The paper demonstrates that a self‑supervised Vision Transformer (ViT) pretrained on a fast, low‑cost semi‑numerical simulator can produce data summaries that transfer across different simulators without retraining. In 21cm cosmology, the ViT—named SKATR—pretrained on 67,000 21cmFAST lightcones is applied unchanged to hydrodynamical Loreli II lightcones, enabling accurate inference of five astrophysical parameters with fewer radiative‑transfer simulations than a fully‑supervised baseline. SKATR remains accurate, informative, and calibrated even under realistic SKA antenna array noise, outperforming supervised models retrained on noisy data.

arXiv Computer Vision

Sep 17

STRADAViT: Self-Supervised Domain Adaptation of Vision Transformer Backbones for Radio Astronomy

STRADAViT is a self‑supervised continued‑pretraining framework that adapts Vision Transformer (ViT) backbones for radio‑astronomy image analysis. It curates mixed‑survey data, generates radio‑astronomy‑aware training views, and initializes encoders with ViT‑MAE, optionally adding register tokens. Evaluations on three morphology benchmarks (MiraBest, LoTSS DR2, and Radio Galaxy Zoo) show that a register‑based two‑stage checkpoint improves linear‑probe Macro‑F1 scores over the ViT‑MAE baseline and enhances fine‑tuning on MiraBest and RGZ DR1, though performance on LoTSS DR2 fine‑tuning declines; these differences are statistically significant.

By Andrea DeMarco, Ian Fenech Conti, Hayley Camilleri, Ardiana Bushi, Simone Riggi

llms computer-vision fine-tuning benchmarks

arXiv Machine Learning

Jun 4

Flow Matching Calibration for Simulation-Based Inference under Model Misspecification

arXiv:2509. 23385v5 Announce Type: replace-cross Abstract: Simulation-based inference (SBI) is transforming experimental sciences by enabling parameter estimation in complex non-linear models from simulated data.

By Pierre-Louis Ruhlmann, Michael Arbel, Florence Forbes, Pedro L. C. Rodrigues

diffusion benchmarks

arXiv Machine Learning

Sep 30

SIFARI: Self-Supervised Interferometric Fitting for Astronomical Radio Imaging

arXiv:2609.35966v1 Announce Type: cross Abstract: Radio-interferometric images are reconstructed from sparsely sampled visibilities, and CLEAN-based imaging can struggle with spatial filtering, compl...

By Shunyuan Mao, Andrea Isella, Paris Perdikaris, Li-Ta Lo, Hui Li

benchmarks

arXiv Machine Learning

Jun 9

Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

arXiv:2604. 09787v2 Announce Type: replace-cross Abstract: Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument.

By Pablo Mercader-Perez, Carolina Cuesta-Lazaro, Daniel Muthukrishna, Jeroen Audenaert, V. Ashley Villar, David W. Hogg, Marc Huertas-Company, William T. Freeman

multimodal

arXiv AI

Jun 30

Domain-Informed Multi-View Self-Distillation for Astronomical Light-Curve Representation Learning with JEPA

arXiv:2606. 28446v1 Announce Type: cross Abstract: Light curves describe temporal variations in the brightness of celestial objects.

By Yicheng Rui

rag nlp fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 10

Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions

arXiv:2606. 10023v1 Announce Type: cross Abstract: Accurate posterior estimation is central to scientific inference, as uncertainties determine what can be reliably learned from observational data.

By Ludvig Doeser, Jens Jasche

arXiv Machine Learning

Oct 5

A Missing Latent, Not a Missing Simulator: Radius-Augmented Inference for Real JWST Retrieval

arXiv:2610.02245v1 Announce Type: cross Abstract: Amortized simulation-based inference (SBI), which is trained on radiative-transfer simulators, recovers exoplanet atmospheres accurately on synthetic...

By Angshuman Chakravertty, P V V Raj

arXiv Computer Vision

Sep 1

Off-Manifold Refinement: Guiding Video Generators with a Frozen World Model

arXiv:2608.29904v1 Announce Type: new Abstract: Modern video generators routinely fail at physical dynamics: objects float, trajectories violate gravity, contacts vanish. Standard denoising and flow-...

By Hai Nguyen-Truong, Tuan-Anh Vu, Dang Huynh

rag

arXiv AI

Sep 10

Field-level weak lensing cosmology with $60$ simulations using multifidelity simulation-based inference

arXiv:2606.23346v2 Announce Type: replace-cross Abstract: We perform a realistic KiDS-Legacy mock analysis with field-level neural compression and simulation-based inference using just 60 $N$-body si...

By Alex A. Saoulis, Kiyam Lin, Niall Jeffrey, Maximilian von Wietersheim-Kramsta, Davide Piras, Alessio Spurio Mancini, Ana M. G. Ferreira, Benjamin Joachimi

fine-tuning

arXiv Machine Learning

Jul 31

Emulating Cosmic Structure Formation with a Lagrangian Neural Cellular Automaton

arXiv:2607. 27320v1 Announce Type: cross Abstract: Field-level inference of cosmological initial conditions from galaxy surveys requires a forward model that is simultaneously accurate in the non-linear regime, computationally efficient, and fully differentiable.

By Cooper Jacobus, Beatriz Tucci, Oliver Philcox

arXiv Machine Learning

Jun 2

21cmEMUv3: a hybrid diffusion-LSTM emulator of 21cmFAST summary observables

arXiv:2606. 00219v1 Announce Type: cross Abstract: We are witnessing a surge in observations of the cosmic dawn (CD) and epoch of reionisation (EoR), driving an increasing demand for fast and robust theoretical interpretation frameworks.

By Daniela Breitman, Andrei Mesinger, Steven G. Murray, Ivan Nikolic, Roberto Trotta

diffusion benchmarks

arXiv Machine Learning

Jul 16

A plug-and-play approach with fast uncertainty quantification for weak lensing mass mapping

arXiv:2603. 22006v2 Announce Type: replace-cross Abstract: Upcoming stage-IV surveys such as Euclid and Rubin will deliver vast amounts of high-precision data, opening new opportunities to constrain cosmological models with unprecedented accuracy.

By Hubert Leterme, Andreas Tersenov, Jalal Fadili, Jean-Luc Starck

benchmarks

Related stories