arXiv AI

A Modular Multitask Reasoning Framework Integrating Spatio-temporal Models and LLMs

The paper introduces STReason, a modular multitask reasoning framework that combines large language models with spatio‑temporal models to handle complex natural language queries without task‑specific fine‑tuning. STReason decomposes queries into interpretable programs, executes them to produce numerical results and detailed, computation‑grounded explanations, thereby reducing hallucinations. The authors evaluate the system on a new benchmark and show it outperforms advanced LLM baselines, with human studies confirming its credibility and practical utility.

arXiv Computation and Language

Sep 25

STRAND: Benchmarking and Improving Object-Centric Spatio-Temporal Monitoring in Video Large Language Models

STRAND is a new benchmark that tests multimodal large language models’ ability to track objects, their states, and relationships over time in videos. It evaluates intermediate reasoning by breaking queries into sub‑questions and uses Faithful Accuracy to ensure all parts of an answer are correct. The authors also propose an object‑centric framework that builds structured trajectories and shows reduced hallucinations and better temporal consistency compared to existing models.

By Thong Nguyen, Tri Cao, Khoi Le, Cong-Duy Nguyen, Quynh Vo, See-Kiong Ng, Bryan Hooi Kuen-Yew

llms multimodal benchmarks safety

arXiv AI

Oct 2

Interpreting Reasoning of Large Language Models via Partial Information Decomposition

arXiv:2610.00571v1 Announce Type: cross Abstract: Large reasoning models (LRMs) have achieved substantial improvements in solving complex mathematical problems, but often produce lengthy, repetitive,...

By Barproda Halder, Qiuyi Zhang, Sanghamitra Dutta

llms rag fine-tuning safety

arXiv Machine Learning

Oct 9

Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap

The paper introduces GPlan, a generative framework for Generative Spatiotemporal Intent Sequence Recommendation (GSISR) that integrates large language model reasoning into lightweight models. It employs Progressive Implicit CoT Distillation to compress reasoning into latent tokens for low-latency inference, and Spatiotemporal Counterfactual DPO to align plans with real-world constraints, improving sequence coherence and context responsiveness. Experiments and online A/B tests confirm the effectiveness of these techniques, and the authors provide an implementation and dataset on GitHub.

By Sicong Wang, Ruiting Dong, Yue Liu, Bowen Zheng, Jun Meng, Jie Li, Shuaijun Guo, Yu Gu, Fanyi Di, Xin Li

llms reinforcement-learning efficiency

arXiv Computer Vision

1d ago

Event-STVG: Spatio-Temporal Video Grounding for Long-Form Event Reasoning

arXiv:2610.22444v1 Announce Type: new Abstract: Spatio-Temporal Video Grounding (STVG) aims to jointly localize a target in space and time given a natural-language query. Despite continued advances,...

By Yizhe Zhang, Xujia Wang, Songqi Tang, Xujie Tang, Leo Jiahao Jiang, Jiacheng Wang, Bowen Qu, JinBo Li, Qin Wang, Ji Qi, Lei Hou, Bin Xu, Juanzi Li

llms multimodal benchmarks

arXiv Machine Learning

Jul 2

VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning

arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).

By Lingxiao Li, Yifan Wang, Xinyan Gao, Chen Tang, Xiangyu Yue, Chenyu You

llms fine-tuning multimodal benchmarks safety

arXiv AI

Aug 18

Tracking the Truth: Object-Centric Spatio-Temporal Monitoring for Video Large Language Models

arXiv:2605. 08974v2 Announce Type: replace-cross Abstract: While multimodal large language models (MLLMs) have advanced video understanding, they remain highly prone to hallucinations in dynamic scenes.

By Tri Cao, Khoi Le, Thong Nguyen, Cong-Duy Nguyen, Quynh Vo, Anh Tuan Luu, Chunyan Miao, See-Kiong Ng, Shuicheng Yan, Bryan Hooi

llms multimodal benchmarks safety

arXiv Computation and Language

Oct 5

Evaluating Multi-Dimensional Generalization of Large Language Models in Temporal Extraction Tasks

arXiv:2610.02549v1 Announce Type: new Abstract: Time and event expression extraction are fundamental temporal reasoning tasks, but the problem remains difficult due to annotation ambiguity, domain se...

By Fahmid Shahriar Iqbal, Ritam Dutt, Soumitra Das, Arnav Verma, Sagnik Ray Choudhury

llms safety

arXiv Machine Learning

Aug 11

Rethinking Reasoning with MDLMs: Early Exits, Post-hoc Reasoning, and Beyond

arXiv:2510. 19990v2 Announce Type: replace Abstract: The reasoning paradigm, where language models reason before answering, has enabled breakthroughs on tasks such as mathematical problem-solving.

By Zachary Horvitz, Raghav Singhal, Hao Zou, Carles Domingo-Enrich, Zhou Yu, Rajesh Ranganath, Kathleen McKeown

llms diffusion reinforcement-learning fine-tuning

arXiv AI

Jun 12

Representing Time Series as Structured Programs for LLM Reasoning

arXiv:2606. 12481v1 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong reasoning and instruction-following capabilities, making them potentially powerful tools for time-series analysis.

By Jaeho Kim, Changhun Oh, Seokhyun Lee, Irina Rish, Changhee Lee

llms nlp

arXiv Computation and Language

Aug 24

Self-Speculation for Faster Reasoning Models

arXiv:2608.20359v1 Announce Type: new Abstract: Large language models (LLMs) are deployed for increasingly complex tasks involving planning and multi-step decision making, but high-quality performanc...

By Ravisri Valluri, Tung Nguyen, Aditya Grover

llms agents

Hugging Face Trending Papers

Jul 23

ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?

Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse expert-level tasks, but they still struggle with fundamental abilities that humans naturally develop through continuous observation of the real world, such as spatial perception and dynamic reasoning. Recent studies have recognized this gap and introduced dedicated benchmarks to evaluate the spatial-temporal capabilities of MLLMs.

llms multimodal benchmarks

arXiv Computer Vision

Sep 22

Cognitive Action Reasoning for Proactive Robots from Human-Centered Multimodal Observations

The paper introduces ProAction, a multimodal dataset of 10,000 samples comprising visual, audio, and text inputs across 12 daily-life scenarios, designed to support the Proactive Robot Action Reasoning (ProRobo) problem. It presents a two-stage human-in-the-loop annotation pipeline that incorporates appraisal and Theory-of-Mind considerations to generate cognitively grounded high-level action labels. The authors benchmark multimodal large language models and propose MMC2Act, showing that training on ProAction significantly improves proactive action reasoning compared to general-purpose models.

By Zhihao Gu, Kechao Zhu, Yuanfeng Wu, Mohan Liu, Ankit Kumar Shaw, ChenDong Hong, Xuanyu Chen, Dengchen Mei, Xu Tianyi, Lin Wang

llms robotics multimodal benchmarks

Related stories