arXiv AI

Learning Soft Robotic Dynamics with Active Exploration

arXiv Machine Learning
Aug 4

From Digital to Physical Reservoir Computing: Co-Optimizing Soft Robotic Reservoirs via Dynamics Matching

arXiv:2608. 00484v1 Announce Type: cross Abstract: Soft robotic substrates are promising for Physical Reservoir Computing (PRC) because their compliant nonlinear dynamics can provide temporal memory, high-dimensional state transformations, and efficient inference.

By Nicola Visentin, Maximilian St\"olzle, Mariano Ram\'irez Montero, Francesco Braghin, Daniela Rus, Cosimo Della Santina
arXiv AI
Jul 14

Toward Autonomous Soft Robotic Endovascular Navigation via Imitation Learning

arXiv:2510. 09497v2 Announce Type: replace-cross Abstract: In endovascular surgery, endovascular interventionists push a thin tube called a catheter, guided by a thin wire to a treatment site inside the patient's blood vessels to treat various conditions such as blood clots, aneurysms, and malformations.

By Noah Barnes, Ji Woong Kim, Lingyun Di, Hannah Qu, Anuruddha Bhattacharjee, Miroslaw Janowski, Dheeraj Gandhi, Bailey Felix, Shaopeng Jiang, Olivia Young, Mark Fuge, Ryan D. Sochol, Jeremy D. Brown, Axel Krieger
arXiv Machine Learning
Oct 15

Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation

The paper presents a Bayesian deep learning approach for active exploration in model-based reinforcement learning applied to robot manipulation. By improving model calibration and actively selecting transitions that maximize information gain, the method enhances data efficiency during a preliminary exploration phase. Experiments on a realistic robotic arm simulator demonstrate that the approach achieves comparable performance to existing methods while requiring significantly fewer robot executions.

By Carlos Plou, Ana C. Murillo, Ruben Martinez-Cantin
arXiv AI
Oct 1

Tactile Curiosity Drives Robot Interaction

The paper introduces TacEx, a tactile‑curiosity framework that guides reinforcement learning agents to explore contact dynamics by focusing epistemic uncertainty on the tactile channel. By anchoring curiosity to touch, robots learn to manipulate and grasp objects without task rewards or demonstrations, generating an interaction‑dense dataset that supports offline pick‑and‑place policy learning. TacEx also enhances vision‑language‑action models through post‑training, improving downstream performance while remaining sample‑efficient.

By Klemens Iten, Alexander Proshkin, Bhavya Sukhija, Stelian Coros, Andreas Krause, Pieter Abbeel, Carmelo Sferrazza
Hugging Face Trending Papers
Jul 6

Simple-to-Complex Structured Demonstrations for Vision-Language-Action Learning

Vision-Language-Action (VLA) models have demonstrated strong capabilities in robotic manipulation by integrating visual perception, language understanding, and robot action generation. Existing research has primarily focused on improving model architectures, training strategies, and dataset scale, while little attention has been paid to how demonstrations are collected and organized.

arXiv Machine Learning
Oct 19

Shape-Aware Neural Time Fields for Rigid-Body Motion and Manipulation Planning

Shape-Aware Neural Time Fields is a physics‑informed neural motion planning framework that learns a reusable travel‑time (cost‑to‑go) representation for rigid‑body motion, explicitly accounting for distinct geometric restrictions on translation and rotation. The learned field captures local motion difficulty and is combined with a sampling‑based planner that balances progress toward the goal with the cost of reaching nearby poses. Experiments on 2D and 3D planning tasks and non‑prehensile manipulation show substantial improvements in planning success and inference efficiency over neural baselines, while remaining competitive with classical planners at lower planning times, and closed‑loop pushing tests demonstrate fast replanning for reactive execution.

By Yanming Zhou, Yuchen Liu, Ahmed H. Qureshi
arXiv AI
Aug 13

Learning Loco-Manipulation From SMPC Demonstrations With Sparse Offline-to-Online RL

arXiv:2608. 12063v1 Announce Type: cross Abstract: Integrating locomotion and manipulation is essential for robot autonomy, but scaling standard Reinforcement Learning (RL) to complex tasks is severely bottlenecked by the slow, manual process of dense reward shaping.

By Martin Schuck, Maks Sorokin, Simone Manni, Duy Ta, Angela P. Schoellig, Marco Hutter, Simon Le Cleac'H, Jan Br\"udigam