arXiv Computer Vision

Revisiting Numerical Forecasting Models for Language-Based Trajectory Prediction

arXiv Machine Learning
6d ago

Co-Evolving Acting and Forecasting for Language Agents

The paper introduces CoPE, a method that trains language agents by adding multi‑step action targets to the policy backbone. By supervising each action forecasted from preceding histories, CoPE enables acting and forecasting to co‑evolve without extra inference cost. Across five benchmarks, CoPE outperforms existing RL baselines, achieving up to twice the sample efficiency on ScienceWorld and improving overall performance on realistic applications.

By Haofei Yu, Yixing Chen, Yining Zhao, Xuyan Ye, Yuxiang Liu, Zhigang Hua, Yan Xie, Shuang Yang, Jiaxuan You
arXiv Machine Learning
Jun 8

Agentic World Modeling for 6G: Near-Real-Time Generative State-Space Reasoning

arXiv:2511. 02748v2 Announce Type: replace-cross Abstract: We argue that sixth-generation (6G) intelligence is not fluent token prediction but the capacity to imagine and choose -- to simulate future scenarios, weigh trade-offs, and act with calibrated uncertainty.

By Farhad Rezazadeh, Amir Ashtari Gargari, Hatim Chergui, Sandra Lagen, Merouane Debbah, Houbing Song, Lingjia Liu
arXiv AI
Sep 25

AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control

AD-WM is a new action‑discriminative joint‑embedding world model designed for counterfactual model predictive control. It augments residual latent dynamics with action‑recovery regularization based on inverse dynamics and conditional mutual information, while discarding auxiliary heads at test time so that MPC remains unchanged. Experiments on OGBench‑Cube and other simulation environments show substantial gains in hard‑start success and mean success, and zero‑shot transfer to a Franka robot improves pick‑and‑place success from 42.2% to 71.1%.

By Jiabin Qiu, Zixuan Chen, Hongye Cao, Jieqi Shi, Jing Huo, Yang Gao
arXiv Machine Learning
Oct 9

CausalDreamer: Learning Predictive World Models with Latent Disentanglement

CausalDreamer enhances generative world models by freezing the original video tokenizer and re-encoding its latent space into a factored representation that separates controllable versus uncontrollable dynamics and reward-relevant versus reward-irrelevant information. The pretrained dynamics model is fine‑tuned to predict this factored representation, enabling more accurate model‑predictive planning. On the MMBench2 benchmark, CausalDreamer improves normalized scores by 14% on clean tasks and 25% on manipulated variants compared to the baseline, while both models perform poorly on entirely new environments.

By Prince Jha, Nils Lukas, Kun Zhang, Salem Lahlou
arXiv Machine Learning
2d ago

Learning Agentic Time Series Forecasting via Trajectory Distillation and Memory-Based Reinforcement Learning

The paper introduces Cast‑R1, an 8‑billion‑parameter agentic forecasting model that learns to orchestrate analytical and prediction tools through trajectory distillation and multi‑turn reinforcement learning with structured memory. The training pipeline first generates multi‑turn interaction trajectories using a teacher LLM, then fine‑tunes the agent with supervised learning and group relative policy optimization, guided by rewards for accuracy and temporal structure. Experiments across several datasets show that Cast‑R1 effectively equips smaller language models with tool‑augmented, multi‑turn forecasting capabilities within structured workflows.

By Xiaoyu Tao, Mingyue Cheng, Yaguo Liu, Xingpeng Gao, Qingsong Wen, Shijin Wang, Enhong chen