arXiv Statistics ML

On the Tightness and Computational Tractability of Higher-Dimensional Confidence Sequences

The paper investigates higher-dimensional confidence sequences for monitoring multiple data streams. It introduces three extensions of one-dimensional betting-based CSs—a weighted Bonferroni region, a max‑wealth form, and a portfolio region—highlighting that the portfolio is tighter but computationally challenging. To make it practical, the authors propose tractable outer approximations (bounding box, π‑ellipsoid, and their intersection) that preserve validity and outperform existing methods in experiments, enabling applications such as multi‑metric A/B testing and model comparison.

arXiv AI
Aug 19

Adaptive Policy Portfolios for Robust Markov Decision Processes

The paper introduces adaptive policy portfolios for robust Markov decision processes, where a finite set of memoryless randomized policies is synthesized offline and paired with an online selector. It defines robust regret as a measure of portfolio quality, comparing each portfolio member to the optimal policy for each plausible environment. The authors provide a complexity-theoretic analysis of portfolio certification and synthesis, showing that even deterministic portfolios in simple settings are highly complex, and present an offline construction method that can be specialized at runtime.

By Kasper Engelen, Sebastian Junges, Guillermo A. P\'{e}rez, Marnix Suilen
arXiv Machine Learning
Sep 10

High-dimensional Linear Bandits with Knapsacks

The paper studies high‑dimensional linear contextual bandits with knapsack constraints (CBwK), aiming to exploit sparsity for tighter regret bounds. It introduces an online hard‑thresholding estimator integrated into a primal‑dual framework, achieving sub‑linear regret that grows only logarithmically with the feature dimension. Under either a diverse‑covariate or margin condition, the regret improves to τ‑dependent rates, and when both hold simultaneously, a dual resolving scheme yields an even tighter bound. The approach also recovers optimal rates for high‑dimensional contextual bandits without knapsacks, and experiments demonstrate its practical effectiveness.

By Wanteng Ma, Dong Xia, Jiashuo Jiang
Hugging Face Trending Papers
Aug 18

Adaptive Policy Portfolios for Robust Markov Decision Processes

The paper investigates adaptive policy portfolios for Robust Markov Decision Processes (RMDPs), proposing finite sets of memoryless randomized policies generated offline and selected online. It introduces robust regret as a metric for portfolio quality, comparing each portfolio member’s performance to the optimal policy for each plausible environment. The authors provide complexity-theoretic results showing that certifying and synthesizing such portfolios is highly intractable, and they present an offline construction method that can be specialized at runtime.

arXiv Machine Learning
Jun 2

FinTSB: A Comprehensive and Practical Benchmark for Financial Time Series Forecasting

arXiv:2502. 18834v3 Announce Type: replace-cross Abstract: Financial time series (FinTS) record the behavior of human-brain-augmented decision-making, capturing valuable historical information that can be leveraged for profitable investment strategies.

By Yifan Hu, Yuante Li, Peiyuan Liu, Yuxia Zhu, Naiqi Li, Tao Dai, Shu-tao Xia, Dawei Cheng, Changjun Jiang
arXiv Machine Learning
Jul 7

Adaptive Partitioning and Learning for Stochastic Control of Diffusion Processes

arXiv:2512. 14991v2 Announce Type: replace Abstract: We study reinforcement learning for controlled diffusion processes with unbounded continuous state spaces, bounded continuous actions, and polynomially growing rewards: settings that arise naturally in finance, economics, and operations research.

By Hanqing Jin, Renyuan Xu, Yanzhao Yang