arXiv Machine Learning September 18, 2026 By Zijie Cheng, Xiang Li, Yang Peng, Zhihua Zhang

A Finite-Sample Analysis of Quantile Temporal-Difference Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 27313v2 Announce Type: replace-cross Abstract: Quantile temporal-difference learning (QTD) is an effective method for learning return distributions through quantile approximation, yet its finite-time behavior remains poorly understood.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 28

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

arXiv:2608. 27313v1 Announce Type: cross Abstract: We establish a global finite-sample guarantee for synchronous quantile temporal-difference learning (QTD) in tabular distributional reinforcement learning.

By Zijie Cheng, Xiang Li, Yang Peng, Zhihua Zhang

reinforcement-learning

Hugging Face Trending Papers

Aug 27

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

We establish a global finite-sample guarantee for synchronous quantile temporal-difference learning (QTD) in tabular distributional reinforcement learning. The proof separates two stability mechanisms.

reinforcement-learning

arXiv AI

Jul 7

Sign-Separated Asymmetric Finite-Time Error Analysis of Q-Learning

arXiv:2605. 16103v2 Announce Type: replace Abstract: Q-learning is known to suffer from overestimation bias: because the Bellman update maximizes noisy or imperfect action-value estimates, positive errors can be selected and propagated, causing learned values to exceed the true optimal values.

By Donghwan Lee

reinforcement-learning safety

arXiv Machine Learning

Sep 2

Online simultaneous inference for quantiles via smoothed stochastic gradient descent

arXiv:2505.13299v2 Announce Type: replace-cross Abstract: This paper considers the estimation of quantiles via a smoothed version of the stochastic gradient descent (SGD) algorithm. By smoothing the...

By Likai Chen, Georg Keilbar, Wei Biao Wu

efficiency

arXiv Machine Learning

Jul 10

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

arXiv:2607. 08444v1 Announce Type: cross Abstract: In this paper, we study quantile-based distributional reinforcement learning from the perspective of statistical efficiency.

By Zijie Cheng, Yang Peng, Zhihua Zhang

reinforcement-learning

arXiv Machine Learning

Aug 14

Online Inference for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

arXiv:2608. 12973v1 Announce Type: cross Abstract: In this paper, we study how to perform statistical inference for quantile temporal difference learning (QTD) in distributional reinforcement learning.

By Zijie Cheng, Yang Peng, Zhihua Zhang

reinforcement-learning

One email a morning, machine-written

Related stories

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

Sign-Separated Asymmetric Finite-Time Error Analysis of Q-Learning

Online simultaneous inference for quantiles via smoothed stochastic gradient descent

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

Online Inference for Quantile Temporal Difference Learning in Distributional Reinforcement Learning