arXiv Machine Learning

FRWKV+: Periodic-Aware Adaptive Gating for Frequency-Space Linear Time Series Forecasting

arXiv:2605. 15690v2 Announce Type: replace Abstract: Accurate and efficient long-term multivariate time series forecasting requires capturing recurring temporal structure while keeping inference cheap across many variables and horizons.

arXiv Machine Learning
Jun 2

FAiT: Frequency-Aware Inverted Transformer for Multivariate Time Series Forecasting

arXiv:2606. 01306v1 Announce Type: new Abstract: While Transformer-based architectures have established themselves as a dominant paradigm in Multivariate Time Series Forecasting (MTSF), their core self-attention mechanism inherently functions as a low-pass filter, systematically smoothing out high-frequency signals vital for sharp local changes.

By Peng He, Yao Liu, Yanglei Gan, Run Lin, Yuxiang Cai, Qiao Liu
Hugging Face Trending Papers
Aug 12

FM-LLM: A frequency-enhanced mixture-of-experts framework for adapting LLMs to time series forecasting

Recent advances in Large Language Models (LLMs) have spurred cross-modal solutions for time-series forecasting. However, existing methods rely heavily on textual prompts for modality alignment-introducing nontrivial computational overhead and failing to leverage the rich spectral dynamics inherent in time-series data.

arXiv Machine Learning
Sep 3

Compositional Spectral Prompts for LLM-based Online Time Series Forecasting

The paper introduces CoSPOT, an online time series forecasting framework that uses a frozen pre‑trained large language model (LLM) as the core forecaster. CoSPOT adapts to evolving data by applying compositional spectral prompts—frequency‑domain basis prompts weighted by their amplitudes—allowing the model to represent unseen patterns as new combinations of learned bases while updating few parameters. Experiments on real‑world datasets show CoSPOT’s effectiveness in extended online phases and cross‑dataset scenarios with significant distribution shifts.

By Seungyoon Choi, Hyunchul Kim, Jae-Gil Lee, Chanyoung Park
arXiv AI
4d ago

Channel-Dependent State Space Model for Multivariate Time Series Forecasting

The paper introduces Chameleon, a channel‑dependent state space model for multivariate time series forecasting that allows data‑dependent, fine‑grained interactions across variables while maintaining linear scaling with the number of variables. By integrating selective state space models with a Kalman filter and adapting GatedDeltaNet as the backbone, Chameleon improves generalization and achieves lower MSE and MAE on strongly dependent ODE and PEMS datasets compared to both channel‑independent and prior channel‑dependent methods. Across 28 benchmark settings, it outperforms baselines in the majority of cases and demonstrates competitive training‑time and memory efficiency on Traffic and ETT datasets.

By Yu-Cheng Wu, Fan-Keng Sun, Li-Chun Lu, Duane S. Boning
arXiv Machine Learning
Jun 10

One Step Closer to Ground Truth: A Multi-Scale Residual-Aware Representation Learning Pipeline for Predicting Time Series Data

arXiv:2606. 10678v1 Announce Type: new Abstract: Transformer-based models have emerged as leading paradigms in time-series forecasting in recent years, employing self-attention mechanisms to capture long-range dependencies.

By Amrijit Biswas, Mustafa Kamal, Robin Krambroeckers, M. M. Lutfe Elahi, Sifat Momen, Nabeel Mohammed, Shafin Rahman
Hugging Face Trending Papers
Sep 2

Compositional Spectral Prompts for LLM-based Online Time Series Forecasting

The paper introduces CoSPOT, an LLM-based framework for online time series forecasting that uses compositional spectral prompts to adapt to non‑stationary environments. By keeping the large language model frozen and updating only spectral basis prompts derived from frequency‑domain decompositions, CoSPOT efficiently handles long‑term adaptation and unseen patterns. Experiments on real‑world datasets show its effectiveness in extended online phases and cross‑dataset scenarios with significant distribution shifts.