arXiv Machine Learning

Sample-Efficiency of Kolmogorov-Arnold Networks

The paper investigates the sample‑efficiency of Kolmogorov‑Arnold Networks (KANs) in reinforcement learning. Using experiments on the Feynman dataset and Gymnasium benchmarks, the authors find that KANs achieve comparable performance to standard Multi‑Layer Perceptrons while requiring 40% fewer samples, with up to 50% relative performance gains during training. These improvements hold even when reward noise varies, underscoring KANs’ potential for more sample‑efficient RL.

arXiv Machine Learning
Aug 11

V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

arXiv:2608. 07870v1 Announce Type: new Abstract: Improving sample efficiency remains a core challenge in reinforcement learning (RL), especially in real-world settings like robotics, where data collection is costly.

By Donghu Kim, Youngdo Lee, Hojoon Lee, Johan Obando-Ceron, Byungkun Lee, Aaron Courville, Pablo Samuel Castro, Jaegul Choo, Clare Lyle
arXiv AI
Jun 30

Agile Reinforcement Learning through Separable Neural Architecture and Applications

arXiv:2601. 23225v2 Announce Type: replace-cross Abstract: Deep reinforcement learning (RL) is increasingly deployed in resource-constrained environments, yet go-to function approximators - multilayer perceptrons (MLPs) - are often parameter-inefficient due to an imperfect inductive bias for the smooth structure of many value functions.

By Rajib Mostakim, Reza T. Batley, Sourav Saha
arXiv Machine Learning
Jun 2

Coherent Off-Policy Improvement of Large Behavior Models with Learned Rewards

arXiv:2606. 02194v1 Announce Type: new Abstract: Distilling expert demonstration data into large generative models using behavioral cloning is a scalable approach to learning capable policies for robotic control, particularly for dexterous manipulation.

By Christian Scherer, Joe Watson, Theo Gruner, Daniel Palenicek, Ingmar Posner, Jan Peters
arXiv Machine Learning
Oct 15

Active Exploration in Bayesian Model-based Reinforcement Learning for Robot Manipulation

The paper presents a Bayesian deep learning approach for active exploration in model-based reinforcement learning applied to robot manipulation. By improving model calibration and actively selecting transitions that maximize information gain, the method enhances data efficiency during a preliminary exploration phase. Experiments on a realistic robotic arm simulator demonstrate that the approach achieves comparable performance to existing methods while requiring significantly fewer robot executions.

By Carlos Plou, Ana C. Murillo, Ruben Martinez-Cantin