arXiv AI

Fuzzy-MoE: Interpretable Regime-Conditioned Expert Routing for Non-Stationary Multivariate Time Series Forecasting

The paper introduces Fuzzy-MoE, a fuzzy logic‑based Mixture‑of‑Experts model that jointly identifies latent temporal states and routes forecasts to appropriate experts in non‑stationary multivariate time series. By combining local convolutional dynamics with global segmented statistics, the dual‑view fuzzy router uses learnable Gaussian membership functions to compute expert activation strengths, enabling explicit IF‑THEN rule‑based expert selection. Experiments on several public benchmarks show that Fuzzy‑MoE outperforms mainstream forecasting methods while providing interpretable routing diagnostics.

Hugging Face Trending Papers
Jun 8

FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting

Large-scale retail and industrial forecasting systems contain many heterogeneous time series whose lifecycle, sparsity, volatility, seasonality, spectral patterns, and contextual sensitivity differ substantially. A single forecasting model rarely performs well across all regimes, while dense ensembles increase inference cost and provide limited insight into expert suitability.

arXiv Machine Learning
Oct 28

GateTS: Versatile and Efficient Forecasting via Attention-Inspired routed Mixture-of-Experts

GateTS introduces a streamlined univariate forecasting model that merges sparse Mixture-of-Experts computation with an attention-inspired gating mechanism, eliminating the need for auxiliary load‑balancing losses. The architecture achieves superior predictive accuracy across both short‑ and long‑term horizons, including intermittent signals, while using far fewer parameters than leading transformer models such as PatchTST. Empirical tests on diverse datasets show GateTS is computationally more efficient than LSTM, enabling cost‑effective inference for real‑world time‑series applications.

By Kyrylo Yemets, Mykola Lukashchuk, Ivan Izonin
arXiv AI
Sep 15

STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting

STHMoE is a Spatio‑Temporal Hypergraph‑Enhanced Mixture of Experts framework designed for urban traffic forecasting. It separates traffic dynamics into frequency‑, time‑, spatial‑, and higher‑order representations, each handled by a prompt‑guided expert built on a partially frozen large language model. The higher‑order expert uses an adaptive hypergraph module to learn evolving spatial structures, while an entropy‑aware router balances expert usage and fuses outputs, achieving competitive results on ten real‑world traffic benchmarks.

By Jiawen Chen, Qi Shao, Yongjian Chang, Mingtong Zhou, Duxin Chen, Wenwu Yu
arXiv Machine Learning
Sep 18

OceanMoE: Structured Conditional Sparse Computation for Long-Horizon Multivariate Ocean Forecasting

OceanMoE is a structured conditional sparse Mixture-of-Experts framework designed for long‑horizon multivariate ocean forecasting. It fuses cross‑variable information to build target‑specific local representations and performs content‑conditioned sparse routing at each spatial location, with the number of active experts adjusted by router confidence. Experiments on ORAS5 data show that OceanMoE reduces aggregate forecasting error and maintains lower geometric‑mean normalized RMSE compared to baselines, while expert allocation varies with prediction targets and locations.

By Yishun Zhu, Jian Wang
arXiv Machine Learning
Sep 29

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang