arXiv AI By Nasim Fallahiarezoodar, Zheng H. Zhu

PPO vs. SAC: A Comparative Study for Cooperative Motion Control of Dual-Arm Space Robots

Read the original on arXiv AI →

The paper compares Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC) for cooperative motion planning of dual‑arm space manipulators tasked with reaching a target while avoiding inter‑arm collisions. A centralized state representation and multi‑objective reward function are used, and SAC consistently outperforms PPO across five random seeds, achieving an 80% success rate within 1.6 M steps versus PPO’s failure to reach this threshold within 4 M steps. Both algorithms degrade on unseen boundary targets, but SAC retains most of its performance while PPO collapses, revealing a reward‑loitering failure mode for PPO. whyItMatters":"The study demonstrates that off‑policy SAC is more robust and effective than on‑policy PPO for coordinating dual‑arm space robots, informing algorithm choice for active debris removal and on‑orbit servicing tasks."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Aug 11

Satellite Trajectory Optimization via Proximal Policy Optimization for Space Debris Avoidance

arXiv:2608. 09628v1 Announce Type: new Abstract: Collision avoidance systems are commonly used to avoid fragmentation events occurring in Low-Earth Orbit (LEO) and Geosynchronous Equatorial Orbit (GEO).

By Logan Luna (Georgia Institute of Technology), Juan Ortiz Couder (Embry-Riddle Aeronautical University), Raul Alejandro Vargas-Acosta (Embry-Riddle Aeronautical University)
arXiv Machine Learning
Jul 13

SafeExplorer: An Unbiased Policy Gradient for Reinforcement Learning with Recovery Interventions

arXiv:2607. 08925v1 Announce Type: new Abstract: Training reinforcement-learning agents directly on physical robots makes every fall costly, since a fall can damage the platform and cannot be undone like a simulator reset; the goal is therefore to minimize falls during training rather than trade them off against return, as constrained Markov decision process (MDP) formulations do.

By Elham Daneshmand, Majid Khadiv, Glen Berseth, Hsiu-Chin Lin