Robotics and embodied AI

Manipulation, locomotion, sim-to-real transfer and autonomous driving: learning systems that have to survive physics.

4,111 stories · RSS feed

arXiv Computer Vision
Aug 21

SceneGTMM: A Conformal Mapping-based Scene-Aware Transferable GNN-Transformer Dual-Graph Interaction Framework for Map Matching

arXiv:2608. 19298v1 Announce Type: new Abstract: Map matching is a key technology connecting positioning data with high precision road networks, but it faces challenges in noise robustness, cross regional transfer, and interpretability.

By Yongliang Zhang, Feng Song, Ji Chen, Lishuai Guo, Yong Deng, Yue Zheng, Tianyi Liu, Zhixiong Chen, Qixin Zhang
Hugging Face Trending Papers
Aug 20

Catching the Rug: Early Prediction of Fraudulent Memecoins on Solana via Machine Learning

The paper presents a method for early detection of fraudulent memecoins (rug pulls) on the Solana blockchain, using a dataset of 6.4 million tokens collected over seven months. It shows that most rug pulls occur within an hour of launch and that classic machine learning models, especially Gradient Boosting (XGBoost), can reliably predict them using only the first five minutes of trading data. Cross‑platform data fusion between PumpFun and Raydium further improves detection by reducing domain shift.

Hugging Face Trending Papers
Aug 20

RoMAN-Flow: Taming Autoregressive Normalizing Flows for Offline Reinforcement Learning in Robotic Manipulation

Offline reinforcement learning improves robotic policies using previously collected data without further environment interaction. Yet prevalent diffusion- and flow-matching robot policies lack tractable likelihoods, limiting their use in likelihood-based offline RL post-training.

Hugging Face Trending Papers
Aug 20

SafeBranch: Branch-Pair Safety Alignment for Embodied Agents

Vision-language-model-based embodied agents can complete instructed tasks but often violate safety constraints in the process, a problem recently framed as interactive safety. Training such agents to act safely is difficult, since safety and task success are distinct objectives, and safety arises only at a small number of safety-critical steps within a trajectory.

arXiv AI
Aug 20

Breaking the weakest link to evade vision language models

The paper investigates how Vision Language Models (VLMs) can be fooled by small, human‑imperceptible changes to images. It introduces a gradient‑based attack that targets only the vision encoder, reducing computational cost while still effectively disrupting both untargeted and targeted multimodal alignment. Experiments on open‑source VLMs such as Qwen2.5‑VL, Granite‑Vision, FastVLM, and Phi‑3.5‑Vision demonstrate that these perturbations can significantly alter the models’ textual outputs.

By Ilan Zini, Boussad Addad, Katarzyna Kapusta
arXiv AI
Aug 20

DA-WAM: Decision-Aligned Future Latents for Driving World Models

DA‑WAM is a framework that integrates predictive representation learning, action‑conditioned future modeling, and trajectory scoring into a single decision‑making objective for autonomous driving. It uses an online encoder with a stable momentum target to keep future representations aligned with the driving task, generating a distinct future latent for each trajectory candidate. A future‑latent‑conditioned scorer evaluates these latents, with expert‑matched trajectories supervised by observed futures and safety‑critical hard negatives providing additional guidance, achieving state‑of‑the‑art results on NAVSIM‑v1 and NAVSIM‑v2.

By Ruiguo Zhong, Benshan Ma, Xiaolong Chen, Lang Zhang, Mingyue Feng, Yaonong Wang, Pei Liu, Jun Ma
arXiv AI
Aug 20

One-Stage Object Detectors in Autonomous Driving

The paper surveys one‑stage object detectors for autonomous driving, covering the evolution from early models like YOLOv1 and SSD to recent real‑time architectures such as YOLOv10 and anchor‑free detectors like FCOS and CenterNet. It compares these methods on design choices, feature‑fusion strategies, loss functions, deployment trade‑offs, and benchmark performance, while also summarizing datasets, evaluation metrics, open challenges, and future research directions. The survey emphasizes how one‑stage detectors balance speed, accuracy, efficiency, and robustness, noting the gap between benchmark results and dependable real‑world performance.

By Jonel Roman, Ryan Sirjue, Peter Nguyen, Daniel Krutky, Juan Jesus, Sudip Dhakal
arXiv AI
Aug 20

GigaBrain-WBC-0.5: A Behavior World Model for Robust Whole-Body Control with Environment Interaction

GigaBrain-WBC-0.5 is a Behavior World Model that uses a causal Transformer to predict next actions, states, and a distribution over latent behavior commands for humanoid whole-body control. It incorporates an automatic terrain-annotation pipeline to recover 3D contact geometry from motion data, allowing the model to learn how terrain and objects influence dynamics. The system detects implausible commands online, retracts them onto learned behaviors, and achieves high success rates in terrain interaction, command robustness, and fall recovery, with promising hardware trials on different robots.

By Ziyang Cheng, Tianshu Tang, Jinxin Lan, Xinze Chen, Yuhan Gong, Zhichao Liu, Changzhong Wu, Yahao Mao, Zongyan Deng, Mingxuan Ma, Huasen Xi, Yilong Liu, Yutong Wu, Xiaofeng Wang, Yang Wang, Yun Ye, Guan Huang, Xiaojie Jin, Zheng Zhu, Jiwen Lu
arXiv Machine Learning
Aug 20

Allocating Recurrent Compute in Looped Language Models

The paper proposes MixerLoop, a looped language model that repeats only the Gated DeltaNet mixer while applying the dense feed‑forward network (FFN) once, instead of repeating the entire layer stack. Using Iterative Transport Rank (ITR) to measure cross‑position influence, the authors show that MixerLoop retains most of the performance gains of full recurrence while reducing FLOPs by 45.9%. Experiments on 15M and 110M parameter models demonstrate that MixerLoop outperforms full‑block recurrence on aggregate CORE metrics.

By Ruhai Lin, Yiyang Guo, Rui-Jie Zhu, Hao Ye, Jason K. Eshraghian
arXiv AI
Aug 20

\textsc{TestifAI}: Tomography-Based Testing for Deep Learning Systems

TestifAI is a deep learning testing framework that estimates model robustness against combinations of semantic input perturbations such as blur, brightness, and zoom. It allows users to define operational conditions as structured spaces with discrete severity levels and query robustness for any combination. By employing partial model tomography, TestifAI reconstructs higher‑order perturbation effects from low‑order tests, achieving less than 7% estimation error while reducing inference counts by 60‑80% across five image and language classification tasks.

By Arooj Arif, Tobias Hartung, Elena Botoeva, Alexandros Koliousis
arXiv AI
Aug 20

A Metamorphic Artificial Age Score Decision-Support Prototype for Flight-Log-Based Drone Propeller Health Monitoring

The paper introduces a Metamorphic Artificial Age Score (AAS) decision-support prototype for monitoring drone propeller health using flight logs. It extracts six health indicators—trajectory tracking error, attitude instability, thrust-command burden, motor-command imbalance, ESC-command instability, and battery-level stress—from MATLAB matrices and normalizes them against a healthy baseline. A controlled retrospective evaluation classified three defective propeller cases into different severity levels, demonstrating that fault effects manifest across multiple operational channels and highlighting the need for a multi-indicator decision-support layer for maintenance prioritization.

By Seyma Yaman Kayadibi
arXiv AI
Aug 20

MLREF: Efficient Module Reuse for Reward Design in Reinforcement Learning via Large Language Models

MLREF introduces a Module Level Reward Evolution Framework that uses a persistent pool of reusable reward components to improve reward design in reinforcement learning. The framework constructs reward functions as linear combinations of modules from this pool and evolves the pool through reflection-based refinement, hybrid credit assignment, and a merge strategy with rollback. Experiments on 17 tasks demonstrate that MLREF outperforms strong baselines, achieving a 25.2% improvement in locomotion and 6.6% in manipulation with more stable optimization dynamics.

By Chenglin Liu, Xun Wang, Ruishuo Chen, Zhuoran Li, Longbo Huang
arXiv Machine Learning
Aug 20

Reinforced Planning with Latent World Models

Reinforced Planning with Latent World Models (RP1) is a novel method that learns to evaluate imagined outcomes via a critic and to improve multi‑step plans through an optimizer trained offline on world‑model roll‑outs. It is the first approach to fully learn plan improvement and can be attached to any pretrained latent world model. In experiments on visual navigation, arm reaching, and robotic manipulation, RP1 outperforms hand‑designed search algorithms, achieving near‑perfect success while using far fewer roll‑outs and running up to 67× faster than the strongest alternative.

By Armin Sommer, Jannik Schilling