arXiv AI
Learning What to Share: Expert Specialization for Time-Series Forecasting
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Sep 29
Aurora-X: Built for Extreme Time Series Forecasting
Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.
arXiv Statistics ML
6d ago
DBCM: Dual-Branch Calibration Module for Test-Time Adaptation in Time Series Forecasting
The paper introduces DBCM, a Dual-Branch Calibration Module designed for test-time adaptation in time series forecasting. It addresses non‑stationarity by sharing adaptation across channels via a shared adapter, while adding a low‑rank channel‑specific adapter and channel mixing with gated modulation. Experiments demonstrate that DBCM outperforms existing methods across various datasets, horizons, and backbone models.
arXiv AI
Jun 9
FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting
arXiv:2606. 08896v1 Announce Type: new Abstract: Large-scale retail and industrial forecasting systems contain many heterogeneous time series whose lifecycle, sparsity, volatility, seasonality, spectral patterns, and contextual sensitivity differ substantially.
arXiv Machine Learning
Sep 10
Not All Variables Agree: Reliability-Aware Variable-Wise Gradient Surgery for Multivariate Time-Series Forecasting
arXiv:2609.08554v1 Announce Type: new Abstract: In data-driven training, multivariate time-series forecasting is usually optimized with a scalar loss averaged over samples, variables, and horizons. T...
Hugging Face Trending Papers
Jun 8
FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting
Large-scale retail and industrial forecasting systems contain many heterogeneous time series whose lifecycle, sparsity, volatility, seasonality, spectral patterns, and contextual sensitivity differ substantially. A single forecasting model rarely performs well across all regimes, while dense ensembles increase inference cost and provide limited insight into expert suitability.
arXiv Machine Learning
Sep 18
OceanMoE: Structured Conditional Sparse Computation for Long-Horizon Multivariate Ocean Forecasting
OceanMoE is a structured conditional sparse Mixture-of-Experts framework designed for long‑horizon multivariate ocean forecasting. It fuses cross‑variable information to build target‑specific local representations and performs content‑conditioned sparse routing at each spatial location, with the number of active experts adjusted by router confidence. Experiments on ORAS5 data show that OceanMoE reduces aggregate forecasting error and maintains lower geometric‑mean normalized RMSE compared to baselines, while expert allocation varies with prediction targets and locations.