arXiv Statistics ML By Andrea Macr\`i, Sebastian Jaimungal, Fabrizio Lillo

Deep reinforcement learning for optimal trading with partial information

Read the original on arXiv Statistics ML →

The paper explores optimal trading under partial information, modeling the trading signal as an Ornstein‑Uhlenbeck process with regime switching. It proposes three reinforcement‑learning approaches that integrate recurrent neural networks to filter latent market regimes, comparing a one‑step method and two two‑step methods that use posterior regime probabilities or signal forecasts. Simulations and an equity pairs‑trading case study show that using posterior probability estimates of the latent regime yields the best cumulative rewards and more interpretable strategies.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv AI
Oct 5

When a Correct Reward Is Not Enough: Diagnosing and Guiding PPO in an Analytically Solved Broker-Trader Game

The paper investigates whether a proximal policy optimisation (PPO) agent can learn to act as a broker in a continuous‑time broker‑trader game that has an analytically solved optimal strategy. By discretising the continuous‑time reward and validating the implementation, the authors show that a PPO agent with a feed‑forward neural network can approximate the reference action when there is no uninformed order flow, but struggles under stochastic uninformed flow, with critics failing to rank actions reliably. The study further demonstrates that a causal certainty‑equivalent controller based on observable history outperforms PPO under partial information, and that freezing the analytical policy and fine‑tuning PPO after a change in execution cost yields a measurable improvement. whyItMatters:"The analytical solution serves both as a diagnostic benchmark for RL performance and as a practical starting policy that can be adapted to changing market conditions, illustrating how theoretical finance models can guide and improve reinforcement learning in complex financial control tasks."

By Siu Tung Wong (Institute of Finance and Technology, University College London), Carlo Campajola (Institute of Finance and Technology, University College London, UZH Blockchain Center)
arXiv Machine Learning
Jul 20

CLaC@FinMMEval 2026 Task 3: Sentiment-Augmented Deep Reinforcement Learning for Active Trading -- An Alpha-Reward Approach

arXiv:2607. 16028v1 Announce Type: new Abstract: This paper presents our system for Task 3 of the CLEF 2026 FinMMEval Lab, which requires daily long, flat, or short trading decisions for Bitcoin (BTC) and Tesla (TSLA) using news and historical market data.

By Andrei Neagu, Eeham Khan, Leila Kosseim