← Back to all news
arXiv Machine Learning By Rapha\"el Bonnet-Guerrini, Johann Ioannou-Nikolaides, Inar Timiryasov, Vincenzo Piuri

Finding and using interpretable latents in a neutrino foundation model with sparse autoencoders

Read the original on arXiv Machine Learning →

The paper applies sparse autoencoders to a neutrino foundation model trained on IceCube data, uncovering a validated atlas of physical concepts within the model’s internal representation. Causal analysis shows the direction reconstruction head largely ignores this atlas, whereas an uncertainty head trained on the same representation effectively uses quality and brightness features, improving angular resolution from 20.2° to 3.2° at 20% efficiency. These findings demonstrate that mechanistic interpretability can expose latent physics and guide the design of downstream tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Related stories

arXiv AI
Sep 28

Neuralyzing the Trace: Selective Representation-Level Unlearning with Contrastive Sparse Autoencoders

The paper introduces SCALPEL, a contrastive sparse autoencoder that selectively learns to unlearn target-specific information from neural network representations. It addresses the energy bias in standard reconstruction-based extractors, which tend to preserve dominant background structure while neglecting low-energy target components. The authors provide theoretical justification that contrastive training enhances target selectivity and demonstrate experimentally that SCALPEL outperforms NMF and standard SAE interventions on the TOFU benchmark, achieving performance comparable to Gradient Difference and RMU methods.

By Itai Zehavi, Fanny Jourdan, Ulrich Aivodji
llmssafety
More like this →
arXiv AI
Oct 12

Local Diagnostics of Learned Event Representations for Anomaly Detection at the HL-LHC

The paper investigates anomaly detection in high-energy physics by learning low-dimensional representations of collision events. Using supervised and self-supervised neural embeddings on a large simulated dataset, the authors find that supervised objectives generally outperform self-supervised ones and improve signal efficiency compared to traditional kinematic-feature autoencoders. They also propose a local diagnostic pipeline that models the Standard Model latent space with a Gaussian Mixture Model, profiles components via high-level observables, and ranks these observables by their local discriminating power, thereby linking anomaly scores to specific kinematic features.

By Donatella Genovese, Philip Ploner, Simone Scardapane, Stefano Giagu, Thea Klaeboe Aarrestad
ragdiffusionbenchmarks
More like this →