The paper proposes a new approach to matrix completion by adding small (ε-level) perturbations to the nullspace of the observation mask, creating noisy surrogates that remain close to the true matrix. These surrogates satisfy a restricted isometry property, enabling the use of tensor methods with theoretical guarantees. The authors provide quantitative recovery guarantees under independent observation assumptions, without requiring explicit sampling rate or incoherence conditions.
arXiv:2605. 17189v2 Announce Type: replace-cross Abstract: Inductive matrix completion (IMC) is a variant of low-rank matrix completion that incorporates row and column side-information.
The paper introduces a deterministic Simulated Oracle Direction (SOD) framework that enables escaping spurious local minima in non‑convex low‑rank matrix sensing without explicit tensor lifting. By projecting over‑parameterized escape directions back into the original parameter space, the method guarantees a strict decrease in objective value from existing local minima. Experiments show reliable escape from local minima and convergence to global optima with minimal computational overhead compared to explicit over‑parameterization.
arXiv:2609. 17048v1 Announce Type: cross Abstract: We study nonconvex methods for matrix completion, the problem of recovering a low-rank matrix from a subset of its entries.
The paper introduces an online generalized-sparsity-constrained regression framework that addresses key challenges in online sparse regression, such as dynamic regularization, memory usage, and real-time computation. It proposes an efficient online hard‑thresholding algorithm that performs closed‑form updates using only summary statistics, achieving global convergence at optimal statistical rates when the projection set is overparameterized. Numerical experiments show the method consistently outperforms existing alternatives in online cardinality‑constrained linear regression and low‑rank matrix sensing.
arXiv:2609.06182v1 Announce Type: cross Abstract: In this paper, we develop and analyze techniques for recovering a linear image $Bx$ of an unknown signal $x$ from indirect noisy observation $\omega=...
arXiv:2607. 07735v1 Announce Type: cross Abstract: Sparse precision matrix estimation provides an interpretable and computationally efficient framework for modeling conditional dependencies in high-dimensional, low-sample-size data.
arXiv:1312. 0925v4 Announce Type: replace Abstract: Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems.
The paper investigates how over‑parameterization affects robustness in matrix sensing, a non‑convex problem equivalent to training a two‑layer quadratic neural network. It introduces a rank‑aware robustness theory for the Burer‑Monteiro factorization, showing that robustness depends on both the degree of over‑parameterization and the local geometry of second‑order stationary points. Based on these insights, the authors propose a trajectory‑aware algorithm that steers optimization toward less sensitive solutions, achieving significant reductions in paired sensitivity in experiments without harming reconstruction accuracy.
arXiv:2610.27010v1 Announce Type: cross Abstract: We study robust estimation of a Gaussian precision matrix that decomposes as a sparse matrix minus a symmetric, possibly indefinite, low-rank matrix,...
The paper tackles learning structured linear dynamical systems when only a few observations are available at each time step. It proposes an estimator that minimizes a bias‑corrected, potentially non‑convex objective and derives non‑asymptotic error bounds that depend on the local complexity of the constraint set, the trajectory length, and the sub‑sampling probability. The authors also prove convergence of projected gradient descent and demonstrate the theory for three specific constraint sets, showing that accurate recovery of the transition matrix is achievable with much shorter trajectories and very low observation rates.
arXiv:2510. 01175v2 Announce Type: replace Abstract: While normalization techniques are widely used in deep learning, their theoretical understanding remains relatively limited.
arXiv:2607. 10618v1 Announce Type: cross Abstract: We consider the recovery of a pair of sparse vectors from a limited number of nonlinear observations of their superposition: $y_i=g(\inner{\ba_i}{\bPhi\bw^\ast+\bPsi\bz^\ast})+e_i$, $i=1,\dots,m$, with $m\ll n$, incoherent orthonormal bases $\bPhi,\bPsi$, a scalar link $g$, and noise $e_i$ that may be heavy-tailed or contaminated.