arXiv Machine Learning

Sim-to-Real Transfer for Muscle-Actuated Robots via Generalized Actuator Networks

arXiv:2604. 09487v2 Announce Type: replace-cross Abstract: Tendon drives paired with soft muscle actuation enable faster and safer robots while potentially accelerating skill acquisition.

arXiv Machine Learning
Jul 14

NeuralActuator: Neural Actuation Modeling for Robot Dynamics and External Force Perception

arXiv:2607. 11734v1 Announce Type: cross Abstract: Differentiable simulators have advanced policy learning and model-based control, yet actuator dynamics remain an important source of sim-to-real error.

By Zhiyang Dou, John U. Onyemelukwe, Hangxing Zhang, Heng Zhang, Minghao Guo, Yunsheng Tian, Michal Piotr Lipiec, Joshua Jacob, Chao Liu, Peter Yichen Chen, Yuri Ivanov, Wojciech Matusik
arXiv Machine Learning
Sep 21

Beyond Kinematics: Benchmarking Simulation Fidelity for Muscle-Driven Imitation Learning

The paper compares two leading motion‑imitation reinforcement learning pipelines—HyFyDy, which uses detailed musculotendon modeling, and MuJoCo, which focuses on computational speed. Using the same human motion‑capture and EMG data, both pipelines reproduce kinematics similarly, but HyFyDy’s muscle activation predictions align more closely with experimental EMG (RMSE 0.164, r = 0.4) than MuJoCo’s (RMSE 0.344, r = 0.11). The authors conclude that HyFyDy’s higher physiological realism makes it currently more suitable for musculoskeletal modeling, though both systems need further development for GPU‑parallelizable environments and robotic assistive‑device design.

By Ayah G. Ahmad, Claire E. Borden, Maegan Tucker
arXiv Machine Learning
Aug 31

Aero Hand Open: A Simulation-Ready Tendon-Driven Hand for Dexterous Manipulation Learning

Aero Hand Open is a tendon‑driven, anthropomorphic hand designed for affordable, simulation‑ready dexterous manipulation. The release includes a realistic simulation model of the cable transmission, an identified actuation map that links motor commands to joint motions (including thumb coupling), and a reinforcement‑learning package that trains policies entirely in simulation. These components enable policies to run on the physical hand without fine‑tuning or state estimation.

By Nan Wang, Mohit Yadav, Jonathan Wulff, Aidan Rosenbaum, Kezhou Chen, Yuvan Sharma, Xu Dong, Yiwei Tao
arXiv Machine Learning
Aug 4

From Digital to Physical Reservoir Computing: Co-Optimizing Soft Robotic Reservoirs via Dynamics Matching

arXiv:2608. 00484v1 Announce Type: cross Abstract: Soft robotic substrates are promising for Physical Reservoir Computing (PRC) because their compliant nonlinear dynamics can provide temporal memory, high-dimensional state transformations, and efficient inference.

By Nicola Visentin, Maximilian St\"olzle, Mariano Ram\'irez Montero, Francesco Braghin, Daniela Rus, Cosimo Della Santina
arXiv Computer Vision
Sep 17

Energy-Regularized Imitation Learning for Force- and Work-Aware Robotic Manipulation

This paper introduces an energy-aware approach to robotic manipulation by defining a joint-space mechanical-work proxy based on joint torque and angular displacement. A differentiable energy predictor is trained to estimate this work from robot states and actions, enabling it to serve as a regularizer that fine‑tunes a pretrained manipulation policy. Applied to RVT‑2 on RLBench, the method reduces average mechanical work from 208.8 J to 204.4 J (a 2.1 % drop) while slightly improving task success from 86.2 % to 86.9 % across 12 manipulation tasks.

By Toshiki Otani, Hiromu Taketsugu, Norimichi Ukita
arXiv AI
Sep 21

Potential-Field Action Representation for Reinforcement Learning in Contact-Rich Manipulation

The paper introduces PA‑RL, a reinforcement‑learning framework that uses artificial potential fields as the action representation for contact‑rich robotic manipulation. Instead of directly commanding motion, the policy adjusts potential‑field parameters, which a Cartesian impedance controller then executes, decoupling task strategy from low‑level control. In peg‑in‑hole experiments, PA‑RL achieved a 100% success rate in simulation, outperformed baselines in torque and acceleration variation, and transferred to a real robot without fine‑tuning.

By Xinyu Liu, G\"okhan Solak, Arash Ajoudani