arXiv Machine Learning September 10, 2026 By Sarvesh Patil

Distributed Dexterous Manipulation with Spatially Conditioned Multi-Agent Transformers

Read the original on arXiv Machine Learning →

The paper introduces Distributed Dexterous Manipulation (DDM), a challenging control problem involving 64 soft delta robots arranged in an 8x8 grid. It presents a framework using spatially conditioned Multi-Agent Transformers (MATs) with adaptive layer norm, spatial contrastive embeddings, and a behavior cloning method fine‑tuned by Soft Actor Critic. Experiments demonstrate that MATs refine actions through stacked attention blocks, enabling long‑horizon planar manipulation in simulation and real‑world settings, while an action‑selection strategy reduces robot usage by about 65% and lowers wear‑and‑tear, achieving an average error of ~1.5 cm.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 17

DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation

arXiv:2605. 31286v2 Announce Type: replace-cross Abstract: Real-world household robots require Vision-Language-Action (VLA) foundation models that can acquire reusable manipulation skills across diverse objects, task conditions, and household environments.

By Taiyi Su, Jian Zhu, Tianjian Wang, Youzhang He, Zitai Huang, Jianjun Zhang, Chong Ma, Hanyang Wang, Tianjiao Zhang, Munan Yin, Weihao Ding, Yi Xu

llms diffusion robotics efficiency multimodal benchmarks safety

arXiv AI

Jul 29

A context-adaptive policy framework for robust and reactive robotic manipulation via uncertainty-aware imitation learning

arXiv:2410. 24035v2 Announce Type: replace-cross Abstract: Generating robust and reactive manipulation strategies that can adapt to changing context information is a challenging task in robotics.

By Tim R. Winter, Leonard Kl\"upfel, Ashok M. Sundaram, Werner Friedl, Maximo A. Roa, Freek Stulp, Jo\~ao Silv\'erio

robotics benchmarks

arXiv Machine Learning

Sep 17

Reinforcement Learning for Real-Time Vision-Language-Action Policies

The paper presents Real‑Time EXPO‑FT, a reinforcement learning framework that fine‑tunes large Vision‑Language‑Action models for real‑time robotic control. It separates slow, expressive action generation from fast, reactive edits, allowing a lightweight policy to adjust actions based on the latest observation. Experiments on the Kinetix benchmark and four dynamic real‑world tasks show that Real‑Time EXPO‑FT achieves superior performance, improving policy success rates from 42% to 97% with only ten minutes of online data and no human intervention.

By Perry Dong, Kuo-Han Hung, Dorsa Sadigh, Chelsea Finn

reinforcement-learning robotics fine-tuning efficiency multimodal benchmarks

arXiv Machine Learning

Jun 11

Self-Supervised Multisensory Pretraining for Contact-Rich Robot Reinforcement Learning

arXiv:2511. 14427v4 Announce Type: replace-cross Abstract: Effective contact-rich manipulation requires robots to synergistically leverage vision, force, and proprioception.

By Rickmer Krohn, Vignesh Prasad, Gabriele Tiboni, Georgia Chalvatzaki

llms rag agents reinforcement-learning robotics multimodal

arXiv AI

Jul 20

SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training

arXiv:2506. 04147v5 Announce Type: replace-cross Abstract: Building capable household and industrial robots requires mastering the control of versatile, high-degree-of-freedom (DoF) systems such as mobile manipulators.

By Jiaheng Hu, Peter Stone, Roberto Mart\'in-Mart\'in

reinforcement-learning robotics benchmarks safety

arXiv AI

Jul 13

PAC-ACT: Post-training Actor-Critic for Action Chunking Transformers

arXiv:2607. 09590v1 Announce Type: cross Abstract: Precision industrial contact manipulation requires reliable robot policies under pose perturbations and contact-force constraints.

By Yujie Pang, Zudong Li

llms rag robotics fine-tuning efficiency multimodal benchmarks safety

One email a morning, machine-written

Related stories

DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulation

A context-adaptive policy framework for robust and reactive robotic manipulation via uncertainty-aware imitation learning

Reinforcement Learning for Real-Time Vision-Language-Action Policies

Self-Supervised Multisensory Pretraining for Contact-Rich Robot Reinforcement Learning

SLAC: Safe and Efficient Real-Robot Reinforcement Learning via Unsupervised Simulation Pre-Training

PAC-ACT: Post-training Actor-Critic for Action Chunking Transformers