arXiv Machine Learning By Yunfei Xie, Howard H. Qian, Shiyi Lan, Kaiyu Hang, Chen Wei

Sensorimotor Alignment: A Platonic Proxy for Embodied Policy Success

Read the original on arXiv Machine Learning →

The paper introduces Sensorimotor Alignment (S²), a training‑free offline metric that evaluates how well a model’s sensory representations match the geometry of physical motion. It demonstrates that higher S² scores correlate with better downstream robot task performance across various embodied model families, providing a low‑cost proxy for model selection before expensive closed‑loop testing. Additionally, S² can identify promising vision‑language model backbones early and offers representation‑level explanations for observed behaviors in vision‑language‑action models and world action models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Jun 18

HumanScale: Egocentric Human Video Can Outperform Real-Robot Data for Embodied Pretraining

Embodied foundation models are expected to benefit from data scaling like large language models, but face a much tighter data bottleneck. Teleoperated real-robot trajectories remain the dominant pretraining source due to their precise action supervision and embodiment alignment, yet their scalability is limited by high collection cost, acquisition difficulty, and low behavioral and environmental diversity.

arXiv AI
Sep 21

AtomEgo: Exploring Ego-Robot Integration for Embodied Foundation Model Pretraining

AtomEgo investigates how to integrate large-scale egocentric human interaction data into embodied foundation model pre‑training. The study uses a curated 2,659‑hour corpus and a scalable data pipeline to evaluate three co‑training paradigms across vision‑language‑action and world‑action architectures. Results show that the benefit of egocentric data depends on both its scale and the quality of alignment with robotic embodiment, offering practical guidance for scalable ego‑robot pre‑training.

By Di Wu, Dongchen Zheng, Junhe Sheng, Zhongxing Wei, Songxin Zhang, Zejian Xie, Xiaoquan Sun, Junyang Zheng, Zhuoyang Song, Jiaxing Zhang, Jiayu Chen