arXiv Computer Vision
Oct 16

Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction

The paper introduces Future‑L1, an interleaved latent visual reasoning framework that alternates between language tokens and continuous latent visual spans during autoregressive decoding for video event prediction. By training on a curated dataset (Future‑L1‑50K) and optimizing latent trajectories with a latent‑aware RL objective (LA‑DAPO), Future‑L1 achieves state‑of‑the‑art results on FutureBench and TwiFF‑Bench, outperforming prior models by significant margins. The work demonstrates that preserving intermediate visual semantics in latent space, rather than verbalizing every reasoning step, leads to more accurate and visually grounded future predictions.

By Tianxiang Jiang, Linquan Wu, Sheng Xia, Songze Li, Ziang Yan, Haoyu Yang, Yu Qiao, Yi Wang