arXiv Machine Learning

$L_0$ Feature Selection via Monte Carlo Tree Search in High-Dimensional Financial Regression

The paper introduces a feature selection framework for high‑dimensional financial regression that uses Monte Carlo Tree Search with Generalized Nested Rollout Policy Adaptation. It treats feature selection as a sequential decision process and evaluates candidate subsets by out‑of‑sample validation performance, incorporating subset size and multicollinearity into a lexicographic objective. Applied to a NASDAQ‑100 weekly return regression with 1,072 engineered features, the method outperforms an optimized Lasso baseline, achieving an out‑of‑sample R² of 0.6961 versus 0.6313.

arXiv Statistics ML
Aug 31

Autotune: fast, accurate, and automatic tuning parameter selection for Lasso

The paper introduces μs’ autotune, an automatic tuning strategy for the Lasso that optimizes a penalized Gaussian log‑likelihood over regression coefficients and noise standard deviation. Extensive simulations on regression and VAR models show that autotune is faster and yields better generalization and model selection, especially in low signal‑to‑noise regimes. The method also delivers a new noise‑standard‑deviation estimator, a visual diagnostic for sparsity, and is demonstrated on a real‑world financial dataset, with an accompanying R package available on GitHub.

By Tathagata Sadhukhan, Ines Wilms, Stephan Smeekes, Sumanta Basu
arXiv Statistics ML
Oct 19

Cointegrated Regressors: Where Folded Concave Penalties Go Beyond LASSO

The paper discusses the limitations of LASSO in high‑dimensional regression models when cointegrated regressors are present, noting that the convex penalty can overly shrink their coefficients and lead to inconsistent estimation. It proposes using folded concave penalties (FCP), such as SCAD and MCP, to overcome this issue, establishing both local and global oracle properties for the penalized regression. Simulation results and an application to euro area unemployment forecasting demonstrate that FCP improves variable selection and out‑of‑sample prediction compared to LASSO.

By Hongqi Chen, Chengwang Liao, Ziwei Mei, Zhentao Shi
arXiv Machine Learning
6d ago

Tabular Foundation Models for Credit Risk Prediction: A Dedicated Review and Empirical Comparison

arXiv:2605.18147v3 Announce Type: replace Abstract: Predictive models are central to credit risk management, where the accuracy of default-probability and loss estimates affects the profitability of...

By Bart Baesens, Andreas Goethals, Stefan Lessmann, Simon De Vos, Cristi\'an Bravo, David Martens, Victor Medina-Olivares, Christophe Mues, Maria Oskarsd\'ottir, Seppe vanden Broucke, Tony Van Gestel, Tim Verdonck, Wouter Verbeke
arXiv AI
Oct 12

SelectArena: A Modern Benchmark for Feature Selection on Real-world Tabular Data

SelectArena is a new benchmark for feature selection on real-world tabular data, evaluating 15 popular methods across 71 curated datasets for both classification and regression tasks. The study uses standardized protocols and modern foundation models, revealing trade-offs among predictive performance, runtime, stability, and validity. Tree-based methods (CART, RFImportance) and the F-Test emerge as Pareto-optimal choices, while search-based methods perform poorly in speed and stability.

By Bastian Sch\"afer, Dominika Matus, Lennart Purucker, Ricardo Knauer, Erik Rodner, Frank Hutter, Anton Sokolov, Arnaud Liefooghe
arXiv Machine Learning
Aug 5

Prediction-Enhanced Monte Carlo: A Machine Learning View on Control Variate

arXiv:2412. 11257v4 Announce Type: replace-cross Abstract: For many complex simulation tasks spanning areas such as healthcare, engineering, and finance, Monte Carlo (MC) methods are invaluable due to their unbiased estimates and precise error quantification.

By Fengpei Li, Haoxian Chen, Jiahe Lin, Arkin Gupta, Xiaowei Tan, Honglei Zhao, Gang Xu, Yuriy Nevmyvaka, Agostino Capponi, Henry Lam
Hugging Face Trending Papers
Aug 27

Tabular Deep Learning for Algorithmic Trading: Cross-Regime Bayesian Optimisation for Equity Signal Generation

The paper explores tabular deep learning for equity signal generation, training five model classes on daily data from about 300 large‑cap US stocks over eleven years. By using Bayesian optimisation that targets trading performance across three distinct market regimes, the authors achieve regime‑robust hyperparameter selection, yielding out‑of‑sample signal precision above random and a Hybrid ensemble (XGBoost + TabNet) with an annualised return of 51.26% and a Sharpe ratio of 2.44. The study also finds that alternative data adds limited value beyond technical and fundamental features, and that the ensemble’s outperformance is driven by stock selection rather than market exposure.