arXiv Machine Learning June 17, 2026 By M. Forzo, E. Monzio Compagnoni, A. Russo, A. Pacchiano

A Diffusion Approximation for Temporal-Difference Learning with Linear Features under Markovian Noise

Read the original on arXiv Machine Learning →

arXiv:2606. 18183v1 Announce Type: cross Abstract: Temporal difference (TD) learning with linear function approximation is a core method for policy evaluation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

diffusion

Hugging Face Trending Papers

Jul 22

Generalized Kalman filter based temporal difference reinforcement learning

In this paper, we present a generalized temporal-difference (TD) reinforcement learning framework based on the theory of conditional expectations. The value and action-value (Q-value) functions are treated as uncertain quantities, and their estimation is formulated as a stochastic inference problem.

reinforcement-learning

arXiv Machine Learning

Jul 23

Generalized Kalman filter based temporal difference reinforcement learning

arXiv:2607. 20010v1 Announce Type: new Abstract: In this paper, we present a generalized temporal-difference (TD) reinforcement learning framework based on the theory of conditional expectations.

By Vasos Arnaoutis, Eric Lutters, Bojana Rosi\'c

reinforcement-learning

arXiv Machine Learning

Jun 5

Fast and Robust Convergence Rate for TD(0) with Linear Function Approximation, Universal Learning Steps and I.I.D. Samples

arXiv:2606. 05967v1 Announce Type: cross Abstract: In this paper, we study the finite-time behavior of the TD(0) temporal-difference method with linear function approximation (LFA).

By Ziad Kobeissi (L2S), \'Elo\"ise Berthier (U2IS)

arXiv AI

Jul 17

Reinforcement Learning in Switching Non-Stationary Markov Decision Processes: Algorithms and Convergence Analysis

arXiv:2503. 18607v2 Announce Type: replace-cross Abstract: We introduce the Switching Non-Stationary Markov Decision Process (SNS-MDP) framework, in which the environment transitions among a finite set of MDPs governed by a latent Markov chain while the agent observes only the external state.

By Mohsen Amiri, Sindri Magn\'usson

agents reinforcement-learning

arXiv AI

Sep 10

Noisy-Space Policy Gradient for Diffusion Policies in Offline Reinforcement Learning

arXiv:2609.06882v1 Announce Type: cross Abstract: Diffusion policies offer a powerful and expressive parameterization for continuous control. Yet, their integration with reinforcement learning remain...

By Mahmoud Selim, Cristina Cipriani, Karl H. Johansson

diffusion reinforcement-learning benchmarks

arXiv Machine Learning

Aug 26

Stabilizing Temporal Difference Learning via Implicit Stochastic Recursion

arXiv:2505.01361v3 Announce Type: replace Abstract: Temporal difference (TD) learning is a foundational algorithm in reinforcement learning (RL). For nearly forty years, TD learning has served as a w...

By Hwanwoo Kim, Panos Toulis, Eric Laber

reinforcement-learning

One email a morning, machine-written

Related stories

Generalized Kalman filter based temporal difference reinforcement learning

Generalized Kalman filter based temporal difference reinforcement learning

Fast and Robust Convergence Rate for TD(0) with Linear Function Approximation, Universal Learning Steps and I.I.D. Samples

Reinforcement Learning in Switching Non-Stationary Markov Decision Processes: Algorithms and Convergence Analysis

Noisy-Space Policy Gradient for Diffusion Policies in Offline Reinforcement Learning

Stabilizing Temporal Difference Learning via Implicit Stochastic Recursion