arXiv AI By Eun Go, Rohan Deb, Arindam Banerjee

Plan Before You Trade: Inference-Time Optimization for RL Trading Agents

Read the original on arXiv AI →

FinPILOT is a plugin inference‑time policy optimization framework that enhances pretrained reinforcement‑learning trading agents by leveraging a multi‑step price forecaster to generate imagined market trajectories. At each decision point, it optimizes the pretrained policy using the forecaster’s predicted price path before executing a trade, without altering the original training pipeline. Across five pretrained policies and multiple market settings, FinPILOT consistently improves total return and Sharpe ratio, with gains increasing as forecast accuracy improves.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 23

Financially Guided Deep Portfolio Optimization

arXiv:2605.28853v2 Announce Type: replace-cross Abstract: Portfolio optimization in real-world financial markets is notoriously difficult due to non-stationarity, noisy data, and high transaction cos...

By Rahul Fernandes, Travis Desell
arXiv Computation and Language
Sep 30

Can Language Models Learn to Forecast Stock Prices

arXiv:2609.36914v1 Announce Type: new Abstract: Post-training has been shown to significantly improve language models' performance on tasks with verifiable outcomes, including mathematical reasoning,...

By Jiacheng Guo, Suozhi Huang, Shuzhen Li, Yunlong Gao, Zerui Cheng, Jason Ge, Shushu Liang, Zihao Li, Hao Lu, Ming Yin, Shilong Liu, Jiashuo Liu, Xu Kuang, Mengdi Wang
arXiv AI
Oct 2

PPO-HRAP: Proximal Policy Optimization with a Hybrid Regime-Aware Policy for Risk-Controlled Trading

PPO‑HRAP introduces a hybrid regime‑aware policy that blends Proximal Policy Optimization with a volatility‑conditioned regime prior to balance upside participation and drawdown control in trading. The agent uses market and portfolio features, rewards that combine log return, VIX‑conditioned drawdown penalty, exposure deviation, and turnover cost, and outputs a blended action between the PPO actor and the regime‑derived target exposure. In backtests on SPY (2020‑2022) it achieved a 27.62% total return, 8.48% annualized return, and reduced maximum drawdown from 34.10% to 18.47%, while maintaining stable performance across multiple seeds and ranking first on total return and Sharpe ratio in single‑run cross‑asset tests on QQQ and DIA.

By Duong Hien Chi Kien, Thanh Trung Huynh
arXiv AI
Jun 9

TT-DAC-PS: Twin-Target Deterministic Actor-Critic with Policy Smoothing for Optimal Trade Execution

arXiv:2606. 08379v1 Announce Type: new Abstract: This study addresses the optimal execution of large stock sell programs by introducing TT-DAC-PS (Twin-Target Deterministic Actor-Critic with Policy Smoothing), a deterministic actor-critic architecture that combines twin exponential-moving-average critic targets with pessimistic min backup, TD3-style target policy smoothing noise, delayed actor updates, and conservative Q regularisation to curb overestimation.

By Ilia Zaznov, Atta Badii, Julian Kunkel, Alfonso Dufour