Robotics and embodied AI

Manipulation, locomotion, sim-to-real transfer and autonomous driving: learning systems that have to survive physics.

4,111 stories · RSS feed

arXiv AI
Aug 25

Balancing Safety and Optimality in Robot Path Planning: Algorithm and Metric

The paper introduces the Unified Path Planner (UPP), a graph‑search algorithm that balances safety and optimality by adaptively weighting heuristics and using a local inverse‑distance safety field. UPP auto‑tunes its parameters during search, guaranteeing suboptimality bounds while improving obstacle clearance. Evaluation on ten simulated environments shows UPP achieving a 0.94 OptiSafe score—significantly higher than existing methods—while adding only 0.5–1% to path length and maintaining a 100% success rate, with hardware validation on a TurtleBot confirming practical benefits.

By Jatin Kumar Arora, Soutrik Bandyopadhyay, Sunil Sulania, Shubhendu Bhasin
arXiv AI
Aug 25

Latency-Tolerant Cloud-Edge Collaborative Vision-Language-Action Models via Emergent Representational Specialization

The paper introduces CloudEdgeVLA, a cloud‑edge policy for Vision‑Language‑Action models that treats temporal misalignment as a representation‑learning problem. It encodes delayed observations into slowly varying task features on the cloud while a lightweight edge head fuses the latest cloud feature with current local vision. Experiments on four LIBERO suites show that CloudEdgeVLA retains 63.8–78.0% success under a 40‑step delay window, far outperforming VLASH and single‑path baselines.

By Daojie Peng, Fulong Ma, Bingtao Wang, Sheng Wang, Jun Ma
arXiv AI
Aug 25

Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundations

arXiv:2507.04356v3 Announce Type: replace-cross Abstract: Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This...

By Vyacheslav Kungurtsev, Alessandro Di Frenna, Gustav Sir, Monicah Cherop Naibei, Haozhe Tian, Homayoun Hamedmoghadam, Akhil Anand, Sebastien Gros
arXiv Computer Vision
Aug 25

HOT-POT: Optimal Transport for Sparse Stereo Matching

The paper introduces HOT-POT, a method that applies optimal transport to sparse stereo matching, addressing challenges such as occlusions, motion, and camera distortions. By modeling camera‑projected points as half‑lines and using epipolar and 3D ray distances as cost functions, the authors formulate efficient assignment problems for unsupervised sparse matching. The approach is extended to hierarchical optimal transport for unsupervised object matching, with experiments demonstrating its effectiveness in facial analysis for aligning different landmarking conventions.

By Antonin Clerc, Michael Quellmalz, Moritz Piening, Philipp Flotho, Gregor Kornhardt, Gabriele Steidl
arXiv Computer Vision
Aug 25

ViSMoE: Visual-Aware Sparse Mixture-of-Experts for Embodied Referring Expression Grounding

ViSMoE introduces a visual‑aware sparse Mixture‑of‑Experts framework for embodied referring expression grounding, enabling an agent to navigate real environments and localize a target object from natural language instructions. By routing visual information through specialized experts, the method produces discriminative representations for both navigation views and candidate objects, unlike prior approaches that use a single vision encoder. Experiments on the REVERIE and SOON datasets show that ViSMoE surpasses existing state‑of‑the‑art methods.

By Shuo Feng, Piji Li
arXiv AI
Aug 25

Mamba-based Selective State Space Modeling Improves the Accuracy-Complexity Tradeoff of SmolVLA Vision-Language-Action Experts

arXiv:2608.21407v1 Announce Type: cross Abstract: Vision-language-action (VLA) models face a crucial tradeoff between their task success rate and the policy-call frequency. Executing a single action...

By Farida Mohsen, Thowayba Elkaffash, Mohammad Reza Chalak Qazani, Mohamed Mabrok, Nader Meskin, Ali Safa
arXiv Computer Vision
Aug 25

Generated Reality: Human-centric World Simulation using Interactive Video Generation with Hand and Camera Control

The paper introduces a human‑centric video world model that can be controlled by tracked head pose and joint‑level hand poses, enabling realistic hand‑object interactions. It evaluates existing diffusion transformer conditioning methods and proposes a new 3‑D control mechanism, training a bidirectional diffusion model and distilling it into a causal, interactive system for egocentric virtual environments. Human‑subject experiments show that the system improves task performance and gives users a higher perceived sense of control compared to baseline methods.

By Linxi Xie, Lisong C. Sun, Ashley Neall, Tong Wu, Shengqu Cai, Gordon Wetzstein
arXiv AI
Aug 25

Triplet2Track: A Hierarchical System with Object-Centric Representations for Reliable Long-Horizon Manipulation

Triplet2Track (TTS) is a closed‑loop long‑horizon imitation learning system that uses human videos to reduce robot‑collected data. It represents high‑level subgoals as instance‑grounded triplets, converts them into continuous track priors for execution, and monitors task progress from observations for online replanning. In diverse real‑world long‑horizon tasks, TTS achieves a 74.8% average success rate and supports object‑level and compositional generalization.

By Jianxiang Liu, Gaojing Zhang, Chuan Wen, Qipeng Liu, Yuxuan Zhao, Ning Guo, Wenzhao Lian
arXiv Computer Vision
Aug 25

VeCAS: Vessel-Focused Contrast-Free Angiogram Synthesis for Vascular Interventions

VeCAS is a two‑stage framework that generates contrast‑free X‑ray angiograms from non‑contrast images. Stage I localizes vascular structures using a discriminative model and cross‑modality latent distillation, while Stage II synthesizes angiographic appearance within those regions with a vessel‑focused inpainting model. Experiments on a lower‑limb vascular intervention dataset show that VeCAS improves vascular structural fidelity and image quality, and robotic guidewire navigation tests demonstrate significant reductions in time to target and operation steps.

By De-Xing Huang, Chen-Yu Wang, Hao Liang, Xiao-Hu Zhou, Mei-Jiang Gui, Tian-Yu Xiang, Qin-Yi Zhang, Chen Wang, Xiao-Liang Xie, Shi-Qi Liu, Ming-Yuan Liu, Zhen-Chang Wang, Zeng-Guang Hou