arXiv Computer Vision By Tianxiang Jiang, Linquan Wu, Sheng Xia, Songze Li, Ziang Yan, Haoyu Yang, Yu Qiao, Yi Wang

Imagine Before You Predict: Interleaved Latent Visual Reasoning for Video Event Prediction

Read the original on arXiv Computer Vision →

The paper introduces Future‑L1, an interleaved latent visual reasoning framework that alternates between language tokens and continuous latent visual spans during autoregressive decoding for video event prediction. By training on a curated dataset (Future‑L1‑50K) and optimizing latent trajectories with a latent‑aware RL objective (LA‑DAPO), Future‑L1 achieves state‑of‑the‑art results on FutureBench and TwiFF‑Bench, outperforming prior models by significant margins. The work demonstrates that preserving intermediate visual semantics in latent space, rather than verbalizing every reasoning step, leads to more accurate and visually grounded future predictions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 5

ProAR: Learning Prospective Reasoning with Autoregressive Video Models

ProAR introduces a goal‑oriented reasoning framework for autoregressive video models, adding goal‑frame prediction via an asymmetric attention mask and future representation self‑alignment to guide intermediate states. These mechanisms combine sparse target supervision with dense step‑wise guidance, enabling coherent, goal‑directed generation while keeping computational costs modest. Experiments demonstrate consistent performance gains across visual reasoning benchmarks and training efficiency, achieving comparable results to fully trained baselines with only 25% of the training steps.

By Linghui Shen, Tinghui Zhu, Sheng Zhang, Muhao Chen
Hugging Face Trending Papers
Aug 5

Predict, Then Retrieve: Cross-Instance Future-State Retrieval from Video Prefixes

We introduce Predictive State Retrieval (PSR), a task in which a model observes a short video prefix and a temporal question about an object's future state, then retrieves instances from other videos or images that depict that state. Unlike action anticipation, which predicts a label, moment retrieval, which localizes an observed event within a video, or video generation, which synthesizes pixels, PSR combines anticipation with cross-instance retrieval across multiple temporal horizons.

arXiv Computer Vision
Oct 1

VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning

arXiv:2609.40129v1 Announce Type: new Abstract: Reasoning through video generation offers a promising path toward visual intelligence by modeling latent visual states and their dynamics. However, cur...

By Zehua Ma, Kun Xiang, Yunshuang Nie, Quanlin Chen, Haoyuan Li, Xiuwei Chen, Jiang Ji, Haijun Wu, Zhenyu Xie, Michael Kampffmeyer, Hanhui Li, Xiaodan Liang
arXiv AI
Sep 10

Reason Through the Latent! Making Latent Visual Reasoning Necessary

The paper introduces Causal Visual Recurrent Reasoning (CVRR), a method that forces multimodal models to rely on latent visual states by using recurrent computation as the sole image‑conditioned path to prediction. CVRR initializes recurrence from the question hidden state after a pretrained vision‑language model has processed the image, repeatedly updates this state while re‑reading the same visual evidence, and removes all other visual traces before decoding. Experiments on several benchmarks show that CVRR maintains strong performance while other latent reasoners lose visual competence, and causal interventions confirm that predictions depend on the recurrent visual trajectory.

By Suhyeong Park, Junha Jung, Jaewoo Kang