arXiv Machine Learning

Continuous-time Optimal Stopping through Deep Reinforcement Learning

arXiv:2606. 17545v1 Announce Type: new Abstract: Simulation based solvers for optimal stopping problems must discretize the stopping decision.

arXiv Machine Learning
Jun 9

Latent Spherical Flow Policy for Reinforcement Learning with Combinatorial Actions

arXiv:2601. 22211v2 Announce Type: replace Abstract: Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical.

By Lingkai Kong, Anagha Satish, Hezi Jiang, Akseli Kangaslahti, Andrew Ma, Wenbo Chen, Mingxiao Song, Lily Xu, Milind Tambe
arXiv Machine Learning
Sep 24

Limiting-Kernel Q($\lambda$): Bridging Short and Long Horizons

Limiting‑Kernel Q(λ) (LKQL) is an off‑policy value estimator that blends n‑step truncation with a long‑horizon approximation based on the limiting kernel. It maintains the computational efficiency of n‑step methods while improving policy evaluation accuracy, especially for long‑horizon tasks. The authors prove faster convergence of LKQL’s operator under aperiodicity and near‑on‑policy conditions, and demonstrate empirical gains on MuJoCo continuous‑control benchmarks.

By Tolga Ok, Arman Sharifi Kolarijani, Peyman Mohajerin Esfahani, Mohamad Amin Sharifi Kolarijani
arXiv AI
Sep 10

HyCO: A Hybrid Neural Solver for Combinatorial Optimization

HyCO is a hybrid neural solver that combines a sequential reinforcement learning (RL) solver with a global diffusion model (DM) to tackle combinatorial optimization problems. The RL component builds an initial solution prefix, after which HyCO switches to a conditional DM to finish the remaining decisions. The authors provide a theoretical framework showing that this hybrid approach yields lower expected regret than either method alone, identify an optimal trigger step for the switch, and implement a lightweight adaptive trigger based on policy entropy and RL‑DM disagreement, achieving consistent performance gains across benchmarks.

By Yuheng Li, Di Yang, Haipeng Chen, Yanhai Xiong