arXiv Computer Vision

Reverberation: Learning the Latencies Before Forecasting Trajectories

arXiv AI
Oct 31

Self-Supervised Latent Action-Conditioned World Modeling for Time Series

The paper introduces ACTS-WM, a self‑supervised framework that models latent actions underlying time‑series transitions. It combines a Joint‑Embedding Predictive Architecture encoder with an action‑conditioned world model to predict future representations conditioned on inferred latent actions and task information. Experiments on 22 datasets across four tasks show that ACTS‑WM improves downstream performance compared to pretrained JEPA‑based encoders.

By Chia-Han Kuo, Chengshuai Zhao, Huan Liu, Lo Pang-Yun Ting
arXiv Machine Learning
Oct 3

Variational Streaming Flow: Probabilistic Forecasting in Physical Time

Variational Streaming Flow (VSF) extends the efficient Streaming Flow (SF) framework by learning a latent distribution conditioned on system dynamics, enabling probabilistic forecasting in physical time. Unlike SF’s deterministic velocity field, VSF produces multiple plausible future trajectories, improving predictive accuracy and distributional fidelity across deterministic and stochastic dynamical systems. The method supports long‑horizon rollouts over 1,000 steps, handles bifurcating dynamics, and can be integrated as a plug‑and‑play predictor into Joint‑Embedding Predictive Architecture (JEPA) world models to enhance navigation, motion planning, and manipulation tasks.

By Hans Hao-Hsun Hsu, Minseon Gwak, Soon Hoe Lim, Pan Li, N. Benjamin Erichson
arXiv Machine Learning
Oct 28

TimeWorld: Towards Action-Conditioned Multimodal World Models for Time Series Forecasting

TimeWorld introduces a plug‑in framework for action‑conditioned multimodal world models in time‑series forecasting. It builds on pretrained time‑series foundation models (TSFMs) and adds a Prototype‑Guided Latent Modulation module to embed textual actions into temporal dynamics, along with an Action Contrastive Learning component to sharpen action‑specific response modeling. The authors also present TSWM‑Bench, a cross‑domain benchmark of seven real‑world datasets with textual interventions, showing that simple text‑prefix adaptations outperform conventional multimodal forecasters and that pretrained TSFMs already encode useful world knowledge for action‑conditioned predictions.

By Hang Ni, Weijia Zhang, Hao Liu
arXiv Machine Learning
Sep 29

WorldTS: World Modeling for Multimodal Covariate-aware Time Series Forecasting

WorldTS is a new forecasting framework that models latent dynamics conditioned on multimodal covariates to improve time‑series prediction. It uses a two‑stage training process: first learning latent state dynamics from historical data and covariates, then training a decoder to map predicted latent states back to future observations. Experiments on 21 real‑world datasets demonstrate the effectiveness of this approach.

By Yuhan Zhu, Xiangfei Qiu, Hanyin Cheng, Wangmeng Shen, Chenjuan Guo, Bin Yang, Jilin Hu, Christian S. Jensen
arXiv Machine Learning
Oct 16

Local Temporal Contrasts on Human Motion Data Induce a Latent Geometry

The paper introduces SemTAC, an encoder trained with a temporal-neighborhood contrastive loss to preserve local consistency in human motion time series, enabling inference at temporal scales beyond training. SemTAC outperforms four baselines on a five-step motion sequence discrimination task, especially on truncated sequences where it achieves a median F1 of 0.77 versus 0.27–0.70 for others. Its representations form interpretable geometric trajectories, surpassing a no-structure baseline on a displacement‑smoothness metric.

By Louren\c{c}o A. Rodrigues, Felix Putze
arXiv Machine Learning
Jun 10

One Step Closer to Ground Truth: A Multi-Scale Residual-Aware Representation Learning Pipeline for Predicting Time Series Data

arXiv:2606. 10678v1 Announce Type: new Abstract: Transformer-based models have emerged as leading paradigms in time-series forecasting in recent years, employing self-attention mechanisms to capture long-range dependencies.

By Amrijit Biswas, Mustafa Kamal, Robin Krambroeckers, M. M. Lutfe Elahi, Sifat Momen, Nabeel Mohammed, Shafin Rahman
arXiv Computer Vision
Sep 4

Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving

Drive‑HWM introduces a hierarchical slow‑fast world modeling framework for autonomous driving. The slow model predicts multi‑step future representations, while the fast model jointly predicts the next frame and immediate action using a lightweight multimodal backbone and an autoregressive expert. Dynamic‑Aware Latents, learned through optical‑flow prediction, explicitly capture motion dynamics, and experiments on NAVSIM v1 and v2 show strong driving performance with validated ablation studies.

By Zhaoxin Fan, Tianbao Zhang, Wenjun Wu, Xiaofeng Wang, Yeying Jin, Jian Zhao, Zheng Zhu, Shuicheng Yan