arXiv Machine Learning

Symmetric Linear Dynamical Systems are Learnable from Few Observations

arXiv:2512. 05337v2 Announce Type: replace-cross Abstract: We consider the problem of learning the parameters of a $N$-dimensional stochastic linear dynamics under both full and partial observations from a single trajectory of time $T$.

arXiv Machine Learning
Sep 10

Low-Rank Plus Sparse Matrix Transfer Learning under Growing Representations and Ambient Dimensions

The paper introduces a transfer learning framework for structured matrix estimation when both the ambient dimension and the intrinsic representation grow over time. It models the target parameter as an embedded source component plus low‑rank innovations and sparse edits, and proposes an anchored alternating projection estimator that preserves the transferred subspace while estimating only the new components. Deterministic error bounds are derived that separate target noise, representation growth, and source estimation error, showing improved rates when rank and sparsity increments are small, and the framework is applied to Markov transition matrix estimation and structured covariance estimation with theoretical guarantees and empirical validation.

By Jinhang Chai, Xuyuan Liu, Elynn Chen, Yujun Yan
arXiv Machine Learning
Sep 18

Demystifying Linear Operator Learning for Control Systems

The paper introduces a structured method for learning linear operators in control systems using data. It leverages the framework of (semi)groups for evolution equations to establish structural assumptions and applies inverse‑problems theory to analyze learning algorithms, revealing error decompositions, convergence guarantees, and optimal regularization. Focusing on bounded operators on Hilbert spaces, the authors derive a convergent estimator for time‑varying systems, illustrating the practical power of their approach.

By Max Beier, Nicolas Hoischen, Sandra Hirche, Petar Bevanda
arXiv Machine Learning
Aug 12

Efficient Uncoupled Learning Dynamics with $\tilde{O}\!\left(T^{-1/4}\right)$ Last-Iterate Convergence in Bilinear Saddle-Point Problems over Convex Sets under Bandit Feedback

arXiv:2602. 21436v2 Announce Type: replace-cross Abstract: In this paper, we study last-iterate convergence of learning algorithms in bilinear saddle-point problems, a preferable notion of convergence that captures the day-to-day behavior of learning dynamics.

By Arnab Maiti, Claire Jie Zhang, Kevin Jamieson, Jamie Heather Morgenstern, Ioannis Panageas, Lillian J. Ratliff
arXiv Machine Learning
Sep 22

Transfer Learning for Matrix Completion

arXiv:2507.02248v2 Announce Type: replace-cross Abstract: In this paper, we explore the knowledge transfer under the setting of matrix completion, which aims to enhance the estimation of a low-rank t...

By Dali Liu, Yuying Xie, Haolei Weng
arXiv Machine Learning
Sep 17

Gradient Descent with Stochastic Subspaces via Persistence of Memory

The paper introduces a novel technique called "persistence of memory" to enhance stochastic subspace methods for large‑scale optimisation. By using a weakly correlated guidance vector that is refreshed only at wide intervals, the method provides a structured direction for random subspace descent. The authors demonstrate that this guidance can be efficiently computed in sparse or minibatch settings and present the first theoretical analysis of classical SSD methods for sparse functions, showing alignment with low‑lying Hessian eigenvectors near the optimum.

By Subhroshekhar Ghosh, Clement Z. Q. Ng, Pierre-Louis Poirion, Akiko Takeda