arXiv AI By Brian Charles Brown, Mauricio Munoz, Robert Bridges, David Grimsman, Sean Warnick

A Nonlinear Singular Value Theory for Neural Networks

Read the original on arXiv AI →

arXiv:2605. 06938v2 Announce Type: replace-cross Abstract: Recently Brown et al.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
6d ago

Pseudo-Invertible Neural Networks

arXiv:2602.06042v2 Announce Type: replace-cross Abstract: The Moore-Penrose Pseudo-inverse (PInv) serves as the fundamental solution for linear systems. In this paper, we propose a natural generaliza...

By Yamit Ehrlich, Nimrod Berman, Assaf Shocher
arXiv Machine Learning
1d ago

Deep Symmetric Autoencoders from the Eckart-Young-Schmidt Perspective

The paper presents a theoretical analysis of symmetric autoencoders, a class of deep learning architectures frequently used in machine learning tasks. It distinguishes between different symmetric designs and shows that the reconstruction error of orthonormal symmetric autoencoders can be interpreted via the Eckart‑Young‑Schmidt theorem. Building on this insight, the authors propose an EYS‑based initialization strategy using repeated SVD, and validate its effectiveness through numerical experiments comparing it to conventional deep autoencoders.

By Simone Brivio, Nicola Rares Franco
arXiv Machine Learning
Sep 4

Linearized subspace refinement framework to expose hidden accuracy in trained neural networks

The paper introduces Linearized Subspace Refinement (LSR), a post‑training framework that uses the local linearized model of a trained neural network to compute a low‑dimensional correction via a reduced least‑squares problem. LSR is architecture‑agnostic and improves accuracy across tasks such as function approximation, operator learning, physics‑informed fine‑tuning, and noisy inverse problems, often achieving order‑of‑magnitude error reductions. The method reveals that standard training can leave significant accuracy plateaus due to numerical ill‑conditioning, and it offers a subspace rank that balances correction strength, stability, and noise sensitivity.

By Wenbo Cao, Weiwei Zhang