arXiv Machine Learning August 14, 2026 By Zijie Cheng, Yang Peng, Zhihua Zhang

Online Inference for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 12973v1 Announce Type: cross Abstract: In this paper, we study how to perform statistical inference for quantile temporal difference learning (QTD) in distributional reinforcement learning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

reinforcement-learning

Hugging Face Trending Papers

Aug 27

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

We establish a global finite-sample guarantee for synchronous quantile temporal-difference learning (QTD) in tabular distributional reinforcement learning. The proof separates two stability mechanisms.

reinforcement-learning

arXiv Machine Learning

Aug 17

Online Inference in Distributional Temporal-Difference Learning

arXiv:2608. 14408v1 Announce Type: cross Abstract: We study online statistical inference for functionals of the return distribution under a fixed policy.

By Yang Peng, Liangyu Zhang

arXiv Machine Learning

Aug 28

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

arXiv:2608. 27313v1 Announce Type: cross Abstract: We establish a global finite-sample guarantee for synchronous quantile temporal-difference learning (QTD) in tabular distributional reinforcement learning.

By Zijie Cheng, Xiang Li, Yang Peng, Zhihua Zhang

reinforcement-learning

arXiv Machine Learning

Sep 18

A Finite-Sample Analysis of Quantile Temporal-Difference Learning

arXiv:2608. 27313v2 Announce Type: replace-cross Abstract: Quantile temporal-difference learning (QTD) is an effective method for learning return distributions through quantile approximation, yet its finite-time behavior remains poorly understood.

By Zijie Cheng, Xiang Li, Yang Peng, Zhihua Zhang

arXiv Machine Learning

Sep 2

Online simultaneous inference for quantiles via smoothed stochastic gradient descent

arXiv:2505.13299v2 Announce Type: replace-cross Abstract: This paper considers the estimation of quantiles via a smoothed version of the stochastic gradient descent (SGD) algorithm. By smoothing the...

By Likai Chen, Georg Keilbar, Wei Biao Wu

efficiency

arXiv Machine Learning

Jul 10

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning

arXiv:2607. 08444v1 Announce Type: cross Abstract: In this paper, we study quantile-based distributional reinforcement learning from the perspective of statistical efficiency.

By Zijie Cheng, Yang Peng, Zhihua Zhang

reinforcement-learning

One email a morning, machine-written

Related stories

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

Online Inference in Distributional Temporal-Difference Learning

A Finite Sample Analysis for Quantile Temporal Difference Learning in Distributional Reinforcement Learning

A Finite-Sample Analysis of Quantile Temporal-Difference Learning

Online simultaneous inference for quantiles via smoothed stochastic gradient descent

Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning