arXiv Computer Vision

Beyond Geometric Closure: Measuring and Diagnosing Mechanical Consistency in Visual Dynamics

arXiv Computer Vision
Oct 7

World Models' Last Exam in Physics

arXiv:2610.08791v1 Announce Type: new Abstract: Video world models can produce visually convincing yet physically inconsistent sequences, raising concerns about their reliability for prediction and p...

By Mingju Gao, Qingle Liu, Yuzhao Peng, Xinjie Lin, Ziming Qin, Zheng Jiang, Wenyi Li, Calvin Xiao, Youjie Zheng, Kaisen Yang, Qinhuai Na
arXiv AI
Aug 3

ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency

arXiv:2607. 29169v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies achieve strong performance in robotic manipulation but remain vulnerable to runtime disturbances that break the temporal alignment among visual observations, robot states, and executed actions.

By Wenda Yu, Tianshi Wang, Fengling Li, Xin Li, Jingjing Li, Lei Zhu
arXiv AI
Jun 4

VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training

arXiv:2606. 04708v1 Announce Type: cross Abstract: Universal Manipulation Interface (UMI) enables scalable real-world robot data collection without hardware-specific teleoperation, yet leveraging UMI data to train large-scale Vision-Language-Action (VLA) models remains fundamentally challenging.

By Siyuan Yang, Linzheng Guo, Ouyang Lu, Zhaxizhuoma, Daoran Zhang, Xinmiao Wang, Ting Xiao, Fangzheng Yan, Zhijun Chen, Yan Ding, Chao Yu, Chenjia Bai, Xuelong Li
arXiv AI
Sep 11

Geometry Conditioning in an Embodied SLM: Training Controls and Robustness Diagnostics in a 0.8B Hybrid Model

The paper investigates how incorporating physical-state (geometric) inputs influences a 0.8B hybrid language model with 6.2M trainable parameters for manipulation tasks. Training with geometry-conditioned recurrent decay gates achieves a 28.9% success rate, slightly lower than the 36.7% success when geometry increments are shuffled, and higher than the 24.4% success without explicit geometry. Robustness tests show that a state-only relative-coordinate policy retains most success under frame relabeling, whereas visual policies degrade significantly after small object displacements, indicating no clear advantage from training-time geometric alignment under the tested conditions.

By Hao Li, Haofei Sun, Lin He