arXiv Machine Learning June 30, 2026 By Hugo L. Hammer, Vajira Thambawita, Kristoffer Herland Hellton, P{\aa}l Halvorsen

Improved Predictive Performance and Interpretability for Mesomorphic Neural Networks Using Local Fidelity Regularization

Read the original on arXiv Machine Learning →

arXiv:2606. 29951v1 Announce Type: new Abstract: Interpretable Mesomorphic Neural Networks (IMNs) offer a promising framework that combines the predictive power of deep neural networks with the interpretability of linear models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Jun 17

Stable and Steerable Sparse Autoencoders with Weight Regularization

arXiv:2603. 04198v2 Announce Type: replace-cross Abstract: Sparse autoencoders (SAEs) are widely used to extract human-interpretable features from neural network activations, but their learned features can vary substantially across random seeds and training choices.

By Piotr Jedryszek, Oliver M. Crook

llms safety

arXiv AI

Sep 15

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

The paper discusses tensorizing neural networks by reshaping dense weight matrices into higher-order tensors and approximating them with low-rank tensor network decompositions. This approach offers promising model compression and introduces bond indices that create new latent spaces, potentially enhancing interpretability. Despite encouraging empirical results, tensorized neural networks remain underused, and the authors call for more research to address practical scaling and adoption challenges.

By Safa Hamreras, Sukhbinder Singh, Rom\'an Or\'us

efficiency safety

arXiv AI

Jul 7

Explainable Bayesian deep learning through input-skip Latent Binary Bayesian Neural Networks

arXiv:2503. 10496v2 Announce Type: replace-cross Abstract: Modeling natural phenomena with artificial neural networks (ANNs) often provides highly accurate predictions.

By Eirik H{\o}yheim, Lars Skaaret-Lund, Solve S{\ae}b{\o}, Aliaksandr Hubin

benchmarks

arXiv Machine Learning

Jun 8

Sparsely gated tiny linear experts

arXiv:2606. 07414v1 Announce Type: new Abstract: Sparsity allows scaling model parameters without proportionally increasing computational cost.

By Simon Schug

llms efficiency safety

arXiv AI

Jul 14

Weight-Adjusted Gradients Reveal Parameter Importance and Failure Modes in LLMs

arXiv:2607. 10803v1 Announce Type: cross Abstract: Understanding which parameters are influential in Large Language Models (LLMs) is central to improving their efficiency, reliability, and interpretability.

By Shrestha Datta, Hongfu Liu, Anshuman Chhabra

llms efficiency safety

arXiv Machine Learning

Jun 2

Multigrade Neural Network Approximation

arXiv:2601. 16884v3 Announce Type: replace Abstract: We study multigrade deep learning (MGDL) as a principled framework for structured error refinement in deep neural networks.

By Shijun Zhang, Zuowei Shen, Yuesheng Xu

One email a morning, machine-written

Related stories

Stable and Steerable Sparse Autoencoders with Weight Regularization

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks

Explainable Bayesian deep learning through input-skip Latent Binary Bayesian Neural Networks

Sparsely gated tiny linear experts

Weight-Adjusted Gradients Reveal Parameter Importance and Failure Modes in LLMs

Multigrade Neural Network Approximation