Robotics and embodied AI

Manipulation, locomotion, sim-to-real transfer and autonomous driving: learning systems that have to survive physics.

4,108 stories · RSS feed

arXiv Computer Vision
Sep 1

Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution

arXiv:2608.28995v1 Announce Type: cross Abstract: World models let robots imagine possible futures, but exploiting this capability for real-time control is bottlenecked by a representation misalignme...

By Mohammad Nazeri, Alexandyr Card, Samira Huber, Anuj Pokhrel, Yujun Wang, Ruben Hammele, Daeun Song, S\"oren Pirk, Xuesu Xiao
arXiv Machine Learning
Sep 1

Data Diversity, Not Frequency Invariance: A Controlled and Self-Audited Study of Compression-Robust Deepfake Detection

The study challenges the prevailing belief that frequency-based features and compression-invariant learning are essential for robust deepfake detection. Using a controlled, pre‑registered protocol, a simple EfficientNet‑B0 trained on diverse multi‑quality data outperformed the more complex CAFRL model across all compression levels, with a 3.66 AUC point advantage at CRF 40. After identifying and correcting four experimental defects, the authors found that frequency features added no marginal benefit, while data diversity—particularly real constant‑rate‑factor variants—proved to be the key factor for robustness against H.264 re‑encoding.

By Abbas Aliyev, Samir Rustamov
arXiv Computer Vision
Sep 1

RoboGesture: Real-Time Semantic-aligned Co-Speech Gestures Generation for Humanoid Interaction

arXiv:2608.28693v1 Announce Type: cross Abstract: Enabling humanoid robots to respond to human speech with synchronized and semantically meaningful gestures is fundamental to natural human-robot inte...

By Zifan Wang, Ziang Ren, Pengyang Shi, Zirui Wang, Chenghuai Lin, Tianze Wang, Zekun Qi, Liangliang Zhao, He Wang, Li Yi
arXiv Machine Learning
Sep 1

Towards Continual Test-Time Adaptation of Vision-Language Models in Open-Vocabulary Semantic Segmentation

arXiv:2608.29923v1 Announce Type: cross Abstract: Open-vocabulary semantic segmentation (OVSS) relies on vision-language alignment to recognize arbitrary text-defined categories, yet this alignment i...

By Chandler Timm C. Doloriel, Yunbei Zhang, Sarthak Kumar Maharana, Muhammad Salman Siddiqui, Tor Kristian Stevik, Fadi Al Machot, Kristian Hovde Liland, Habib Ullah
arXiv Machine Learning
Sep 1

Driving on Memory

arXiv:2608.31029v1 Announce Type: cross Abstract: End-to-end autonomous driving models plan future trajectories from raw sensor input. While earlier driving benchmarks often measured deviation from t...

By Christian L\"owens, Thorben Funke, Alexandru Paul Condurache
arXiv Computer Vision
Sep 1

Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory

arXiv:2608.29910v1 Announce Type: new Abstract: Interactive world models extend video generation from offline clip synthesis toward persistent simulation of interactive virtual worlds, enabling appli...

By Runjia Qian, Zile Wang, Jihai Zhang, Kai Zou, Wei Yu, Jiaxing Li, Zexiang Liu, Yaokun Li, Fei Kang, Kaichen Huang, Mengyin An, Haobo Zhang, Biao Jiang, Jiahua Wang, Haofeng Sun, Yang Liu, Yangguang Li
arXiv Computer Vision
Sep 1

OptiGeo: Efficient Monocular Geometry for Embodied Perception in Optically Challenging Scenes

arXiv:2608.29881v1 Announce Type: new Abstract: Monocular depth estimation has achieved strong open-domain generalization, yet reliable robotic deployment remains difficult in transparent, reflective...

By Muxin Liu, Tianbo Liu, Jing Xia, Xiaoyang Lyu, Xiaoshan Wu, Bo Wang, Peng Dai, Zhongrui Wang, Shaoshuai Shi, Xiaojuan Qi
arXiv Computer Vision
Sep 1

ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery

arXiv:2608.20308v2 Announce Type: replace Abstract: Egocentric video offers scalable manipulation data for embodied AI, yet recovering metric 3D hand trajectories remains challenging due to severe ob...

By Yufei Liu, Xixi Wang, Hao Li, Ganlong Zhao, Kaitong Cai, Chengkai Jin, Chunxiao Liu, Jianbo Liu, Siyuan Huang, Xingang Pan, Hongsheng Li