arXiv Machine Learning

Optimal estimation for Functional Linear Regression with Noisy Discretized Data

arXiv Machine Learning
Aug 27

Functional linear regression from sparse to dense designs: a pooling-ridge method and minimax optimality

The paper introduces a pooling‑ridge estimation method for functional linear regression that handles data observed at discrete times, ranging from sparse to dense designs. By combining pooling strategies with RKHS‑based techniques, the authors achieve minimax‑optimal prediction risk for both scalar‑on‑function and function‑on‑function models. The study identifies distinct phase transitions in convergence behavior, with up to three transitions for function‑on‑function regression, and validates the approach through simulations and real data examples.

By Shunxing Yan, Fang Yao
arXiv Machine Learning
Aug 7

Scalable estimation of VARMA models

arXiv:2608. 06340v1 Announce Type: cross Abstract: Vector autoregressive moving-average (VARMA) models have long been considered impractical beyond moderate dimensions: the likelihood is non-convex, the parametrization is identified only up to equivalence, and every evaluation costs a pass over the entire series.

By Daniel Paulin, Victor Elvira
Hugging Face Trending Papers
Aug 6

Scalable estimation of VARMA models

Vector autoregressive moving-average (VARMA) models have long been considered impractical beyond moderate dimensions: the likelihood is non-convex, the parametrization is identified only up to equivalence, and every evaluation costs a pass over the entire series. Yet their moving-average term captures with a few parameters what a pure autoregression matches only with many lags.

arXiv Statistics ML
5d ago

New explanations and inference for least angle regression

The paper introduces a new inference framework for least angle regression (LAR), clarifying its behavior and providing a formal stopping rule. It shows that LAR estimates non‑zero population correlations as independent normal variables, while zero correlations follow a non‑normal joint distribution, enabling variable importance interpretation. A modified bootstrap method is proposed to quantify uncertainty and assess variable entry, with results validated by simulation and data examples.

By Karl B. Gregory, Daniel J. Nordman