arXiv AI By Tian Zijian, Zhang He, Chen XinJie, Liu Xinggao

Dynamical low-rank equilibrium computation for stochastic games between advanced persistent threats and moving target defense

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv Machine Learning
Aug 20

Score the Algebra, Not the Span: Dimension Reduction for Transfer Operator Models of Dynamical Systems

The paper proposes a new dimension‑reduction strategy for transfer‑operator models of dynamical systems that focuses on scoring the σ‑algebra generated by coordinates rather than the operator’s spectral span. By using a χ²‑divergence criterion between embedded present and future states, the method guarantees that twice the intrinsic system dimension suffices to capture the full operator spectrum, even for systems with weakly interacting components that would otherwise require exponentially many modes. Experiments on benchmark systems show that this algebraic approach recovers masked components missed by rank‑based methods and enables accurate prediction of those components from few labels.

By Mark Kozdoba, Shie Mannor
arXiv Machine Learning
Aug 31

Shift Before You Learn: Enabling Low-Rank Representations in Reinforcement Learning

The paper challenges the common assumption that the successor measure in reinforcement learning is approximately low-rank, showing instead that a low-rank structure emerges in a shifted successor measure that ignores initial transitions. It provides finite-sample guarantees for estimating this low-rank approximation, introduces Type II Poincaré inequalities to bound spectral recoverability, and links the necessary shift to the decay of high-order singular values and local mixing properties. Experiments confirm that shifting the successor measure improves goal-conditioned RL performance.

By Bastien Dubail, Stefan Stojanovic, Alexandre Prouti\`ere
arXiv AI
Oct 16

Provably Efficient Risk-Sensitive Offline Reinforcement Learning via Optimized Certainty Equivalents

The paper presents the first provably efficient offline reinforcement learning algorithms for risk-sensitive settings using optimized certainty equivalents (OCE). It introduces two formulations—dynamic-OCE, applying OCE at each step, and static-OCE, applying a single OCE to cumulative rewards—and develops pessimistic value-iteration methods with tight sublinear suboptimality bounds in tabular and linear function approximation settings. The authors also establish minimax lower bounds, characterizing the fundamental limits of offline risk-sensitive RL.

By Hanzhen Wang, Boxiang Lyu, Zhongxiang Dai, Siyang Gao, Dake Zhang, Shuang Qiu