arXiv AI

OmniSpectra: A Unified Foundation Model for Universal Spectra Representation Learning

arXiv Machine Learning
Jun 9

Learning What's Real: Disentangling Signal and Measurement Artifacts in Multi-Sensor Data, with Applications to Astrophysics

arXiv:2604. 09787v2 Announce Type: replace-cross Abstract: Data collected from the physical world is always a combination of multiple sources: an underlying signal from the physical process of interest and a signal from measurement-dependent artifacts from the sensor or instrument.

By Pablo Mercader-Perez, Carolina Cuesta-Lazaro, Daniel Muthukrishna, Jeroen Audenaert, V. Ashley Villar, David W. Hogg, Marc Huertas-Company, William T. Freeman
arXiv Computer Vision
Oct 28

LESSViT: Robust Hyperspectral Representation Learning under Spectral Configuration Shift

LESSViT introduces a sensor‑flexible Vision Transformer for hyperspectral imagery that uses a low‑rank structured attention mechanism (LESS Attention) to efficiently model joint spatial‑spectral interactions. By reducing the complexity from ≠O(N^2C^2) to ≠O(rNC) and adding channel‑agnostic patch embedding with wavelength‑aware positional encoding, it supports flexible spectral inputs. A hyperspectral masked autoencoder (HyperMAE) with decoupled spatial‑spectral masking further enables robust pretraining, and experiments on the SpectralEarth benchmark show improved robustness to spectral shifts while maintaining competitive in‑distribution performance.

By Haozhe Si, Yuxuan Wan, Yuqing Wang, Minh N. Do, Han Zhao
arXiv Machine Learning
Oct 7

Learnable Spectral Activations

arXiv:2610.07419v1 Announce Type: new Abstract: Implicit neural representations (INRs) are shaped by the spectral structure induced by their input encodings and activation functions. Existing methods...

By Tamir Shor, Or Litany, Alex Bronstein
arXiv Machine Learning
Sep 15

Time Series Analysis in Frequency Domain: A Survey of Open Challenges, Opportunities and Benchmarks

The survey reviews frequency‑domain techniques for time‑series analysis, covering classical Fourier methods to modern neural operators. It identifies three main research challenges: preserving causal structure during spectral transformations, quantifying uncertainty in learned frequency representations, and performing topology‑aware analysis for non‑Euclidean data. By reviewing over 100 studies, the authors propose a unified taxonomy, establish standardized benchmarks, and highlight gaps in geometric deep learning and quantum‑enhanced spectral analysis.

By Qianru Zhang, Yuting Sun, Honggang Wen, Peng Yang, Xinzhu Li, Ming Li, Kwok-Yan Lam, Siu-Ming Yiu, Hongzhi Yin
Hugging Face Trending Papers
Jun 17

Transformer Geometry Observatory TGO-I: Spectral Geometry Observatory

Despite the widespread adoption of Vision Transformers (ViTs) and their success across numerous computer vision applications, the fundamental understanding of their dimensional and representational geometry remains relatively underexplored. To address this gap, we introduce Transformer Geometry Observatory (TGO), a systematic framework of experiments and analysis pipelines designed to investigate the representational geometry and dynamics of Vision Transformers.