arXiv Machine Learning By R\'ois\'in Luo, James McDermott, Colm O'Riordan

Lipschitz Continuity in Deep Learning: A Systematic Review of Theoretical Foundations, Estimation Methods, Regularization Approaches, and Certifiable Robustness

Read the original on arXiv Machine Learning →

arXiv:2607. 16329v1 Announce Type: cross Abstract: Lipschitz continuity is a fundamental property of neural networks that characterizes their sensitivity to input perturbations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 14

A Unified and Constrained View of Regularization-Based Robust Reinforcement Learning

The paper presents a unified framework for regularization-based robust reinforcement learning by deriving upper bounds on the performance gap between nominal and worst-case policies. These bounds are expressed as a regularization objective plus a KL-divergence penalty, explaining why KL penalties enhance robustness. The authors reformulate robust training as a constrained optimization problem, updating the Lagrange multiplier jointly with the policy to automatically tune regularization, and validate the approach with extensive adversarial evaluations on continuous control tasks.

By Amine Andam, Jamal Bentahar, Mustapha Hedabou
arXiv Machine Learning
5d ago

LipSSM: Structurally Lipschitz-Bounded Cascaded State-Space Model via Metric Transfer between Consecutive SSM Layers

LipSSM introduces a cascaded state‑space model that enforces Lipschitz continuity across layers by transferring metric information between consecutive SSM layers, thereby tightening the overall Lipschitz bound compared to traditional layer‑wise methods. This approach aims to preserve robustness while improving the expressive capacity of deep neural networks for modeling longer‑term dependencies. The architecture is both theoretically justified and empirically evaluated in the paper.

By Natsuki Yoshino, Ren Uchida, Kazuki Matsumoto, Kohei Yatabe