arXiv Machine Learning

A Constructive Orbit-Based Theory of Learnability

The paper introduces a finite‑dimensional orbit framework that builds data‑adapted dictionaries, sparse realizations, and predictive models using wrapped weighted shifts to create orbit dictionaries and local interpolation maps. It presents CCDS, a deviation‑controlled sparse realization procedure that achieves MP/OMP‑like behavior at minimal deviation while enabling feasible interior paths with specified residual geometry. The authors prove generic orbit independence, exact block interpolation with norm control, bounds on sparse approximation distortion, guarantees on selected supports, and stability under perturbations, and demonstrate that orbit scaffolds outperform random or unstructured alternatives in synthetic and benchmark experiments.

arXiv Machine Learning
Aug 26

Finite-Sample Metric Non-Collapse for Geometrically Supervised Latent World Models in Control

The paper presents a finite‑sample learning‑to‑control framework for geometrically supervised latent models of nonlinear deterministic systems. It introduces an encoder‑only local–global metric hinge that ensures directional resolution and state discrimination, and proves that any approximate empirical minimizer is pointwise co‑Lipschitz and uniformly approximately semiconjugate to the true dynamics under regularity assumptions. The results provide explicit bounds on approximation, sampling, and optimization errors, and demonstrate through controlled experiments that restoring metric resolution improves control performance.

By Alain Bensoussan, Minh-Nhat Phung, Minh-Binh Tran
arXiv Machine Learning
Oct 15

Learning to Design Convex Relaxations for Nonconvex Optimization

The paper introduces AutoConvexRelax, a learning-based framework that automates the design of convex relaxations for nonconvex optimization problems. By representing a problem as a tripartite graph of variables, symbolic terms, and objective/constraint positions, the method learns a policy to compose symbolic rewrites that generate valid relaxation trajectories. Experiments on quadratic and fractional problems show that the learned policy improves McCormick lower bounds by 13.52% and achieves near‑semidefinite bounds while using smaller formulations.

By Jinrun Liu, Bai Yan, Tengfei Liu, Qunfeng Liu, Jian Yang, Shi Cheng, Yuhui Shi, Qi Zhao
arXiv Machine Learning
Oct 5

SD-DPC: Sparse Dictionary Differentiable Predictive Control

The paper introduces SD‑DPC, a method that learns sparse, interpretable feedback policies for nonlinear systems using data. It first identifies a prediction model via rollout‑based sparse identification of nonlinear dynamics (SINDy), then parameterizes the policy as a sparse combination of dictionary functions and trains it by differentiating a constrained finite‑horizon predictive‑control objective. The resulting explicit feedback law contains only a few terms, satisfies constraints across three benchmark problems, outperforms a distilled policy by up to an order of magnitude, and requires far less memory and online computation than an optimization benchmark while providing explicit sensitivity bounds.

By Ali Reza Daneshvar Garmroodi, Jan Drgo\v{n}a
arXiv AI
Jun 17

Transformer-Based Warm-Starting for Feasible and Optimal Terminal Approach to Tumbling Objects with Space Manipulators

arXiv:2606. 17317v1 Announce Type: cross Abstract: Real-time trajectory generation for on-orbit robotic servicing is challenging due to the nonlinear coupling between spacecraft bus motion, manipulator dynamics, visibility cone, and trajectory-level safety constraints.

By Yuji Takubo, Maximilian Adang, Mac Schwager, Simone D'Amico
arXiv Machine Learning
Oct 3

Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers

The paper introduces Reachability Analysis-Informed Reinforcement Learning (RARL) for designing deterministic multi‑impulse interplanetary transfers. RARL uses local first‑order reachability maps to bound velocity perturbations and selects intermediate waypoints, which are then translated into maneuvers via Lambert reconstruction and a terminal two‑impulse solution. Numerical experiments on an Earth‑Mars benchmark show that RARL achieves a mean maneuver cost only 1.72% above a validated convex programming reference and can be trained once to handle a wide range of departure states, achieving 100% feasibility on 10,000 held‑out Monte Carlo departures.

By Yashdeep Chaudhary, Roberto Armellin, Harry Holt
arXiv Machine Learning
Oct 28

Sparse Sum-of-Squares Layers for Certified Learning

The paper introduces Sparse Sum-of-Squares (SOS) Layers, a new type of differentiable layer that reuses the sparse structure of forward semidefinite programming (SDP) solves during backpropagation. By avoiding dense certificate construction, the method achieves up to 2.7× faster warm‑call times and reduces memory usage from 160 GiB to 1.7 GiB on large problems. Experiments demonstrate its effectiveness across sparse polynomial certification, control, combinatorial relaxations, robotics, oscillator chains, and pose‑graph synchronization, achieving zero certified violations on unseen instances with far fewer optimization solves than finite‑difference approaches.

By Ege Gursoy, Nicolas Mansard
arXiv Machine Learning
Oct 9

Learning structured linear dynamical systems from missing observations

The paper tackles learning structured linear dynamical systems when only a few observations are available at each time step. It proposes an estimator that minimizes a bias‑corrected, potentially non‑convex objective and derives non‑asymptotic error bounds that depend on the local complexity of the constraint set, the trajectory length, and the sub‑sampling probability. The authors also prove convergence of projected gradient descent and demonstrate the theory for three specific constraint sets, showing that accurate recovery of the transition matrix is achievable with much shorter trajectories and very low observation rates.

By Aravinda Kanchana Ruwanpathirana, Hemant Tyagi, Sunny G. W. Wang