arXiv AI By Dongjun Wei, Hongyi Wu, Yinuo Zou

Attributing Preprocessing Invariance in Spectral Foundation Models

Read the original on arXiv AI →

arXiv:2608. 14227v1 Announce Type: new Abstract: Preprocessing invariance is an appealing goal for spectral foundation models: a frozen model should remain useful when laboratories preprocess spectra differently.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computation and Language
2d ago

Do Multimodal Models Decide Consistently on Equivalent Optical Spectra?

The study evaluates whether multimodal models produce consistent decisions when presented with equivalent optical spectra in different representations—tables in nanometers, micrometers, scientific notation, or photon energy, and plots in wavelength or energy. Using datasets of silicon metasurfaces and gold nanoparticles, the authors test several models (d3-nano, Jev 1.13, GPT‑6 Luna variants, Qwen3.5‑2B) and find that representation changes can shift accuracy by up to 41 percentage points, with some models benefiting from photon‑energy inputs while others suffer. Fine‑tuning with LoRA improves performance on trained formats but often relies on a shortcut of abstaining when data are truncated; training with answerable truncations mitigates this shortcut, revealing significant gaps in models’ handling of missing evidence.

By Ziyuan Wang, Genliang Zhu, Xiaobo Chen
arXiv Machine Learning
Sep 22

Whitening Inverts the Hierarchy: What the Norm of a Whitened Embedding Measures

The paper investigates the use of the squared norm of a whitened foundation‑model embedding as a training‑free likelihood surrogate. It shows that the apparent Gaussianity of whitened coordinates stems from the projection central limit theorem, not from a true joint Gaussian distribution, and that the norm is systematically over‑dispersed compared to a Gaussian reference. The authors explain that whitening reverses the encoder’s spectral hierarchy, concentrating norm contributions in near‑degenerate directions dominated by noise, and propose interpreting the squared norm as a Mahalanobis measure of semantic atypicality rather than a log‑likelihood.

By Mohammed Ahnouch, Lotfi Elaachak