arXiv Machine Learning By Erdemt Bao, Xing Lei, Jun Chen

NFTR: From Provable Mode-Averaging to Geodesic Subgoal Selection in Offline Goal-Conditioned RL

Read the original on arXiv Machine Learning →

arXiv:2607. 07855v1 Announce Type: new Abstract: Hierarchical Implicit Q-Learning (HIQL), an offline goal-conditioned RL method, selects subgoals by value-function advantages alone.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 27

Provably Efficient Q-learning for Robust Reinforcement Learning

The paper introduces a sample‑efficient asynchronous Q‑learning algorithm for robust reinforcement learning in infinite‑horizon, discounted robust MDPs with total‑variation uncertainty. It proves that, given a single Markovian trajectory, the algorithm achieves an entrywise ε‑approximation of the optimal Q‑function with a sample complexity bounded by a nearly minimax‑optimal expression involving the discount factor, uncertainty level, mixing time, and occupancy probability. This result improves significantly over prior bounds for robust RL.

By Yuchen Jiao, Gen Li
arXiv Machine Learning
2d ago

Statistical Foundations of Reinforcement Learning: A Non-Asymptotic Perspective

The monograph "Statistical Foundations of Reinforcement Learning: A Non-Asymptotic Perspective" surveys recent advances in finite-sample statistical theory for reinforcement learning. It focuses on tabular Markov decision processes and examines three sampling settings—generative model, online, and offline RL—alongside model-based and model-free algorithmic paradigms. The work emphasizes minimax-optimal sample complexity, provides self-contained analyses, and briefly explores extensions such as robust, multi-agent, federated, and human-feedback RL.

By Yuxin Chen, Yuejie Chi, Jianqing Fan, Gen Li, Yuting Wei, Yuling Yan