arXiv Machine Learning

Error- and Prediction-Driven Motor Learning in the Cortico-Cerebellar Loop

The paper presents a cerebellum-inspired control framework that addresses robust control under delayed sensory feedback. By combining multiplexed predictive representations with internal feedback, the model jointly encodes kinematic variables and task-relevant error signals, enabling accurate online correction despite delays. Incorporating feedback within the cerebellar loop also accelerates adaptation, reducing learning time by an order of magnitude.

arXiv AI
Jul 28

Self-Supervised Consistency Enhanced Disentangled Learning for Neural Decoding Generalization in Brain-Machine Interface

arXiv:2607. 24023v1 Announce Type: new Abstract: Brain-Machine Interfaces (BMIs) provide a direct communication pathway between the brain and external devices, enabling humans to control assistive and robotic technologies, with potential applications in rehabilitation, human motor augmentation, and human-centered robotics.

By Jiyu Wei, Di Hong, Zhanjie Zhang, Dazhong Rong, Qinming He, Yueming Wang
arXiv Machine Learning
Aug 27

LM-X: Explainable Action Modeling with Progress, Event, and Uncertainty Prediction for Generalist Robot Manipulation

LM‑X is a generalist vision‑language‑action policy that augments action prediction with three online, explicitly supervised signals: return‑to‑go (RTG) for task progress, event‑to‑go (ETG) for the next semantic transition, and heteroscedastic action flow for local reliability. By conditioning action generation on these signals, LM‑X embeds explainability directly into control rather than as a post‑hoc explanation. After a 20‑day pretraining run on 64 GPUs, LM‑X outperforms an action‑only backbone by 16.0 points and a single‑head variant by 10.8 points, and achieves 74.1 % success on 50 RoboTwin2.0 tasks and 68.6 % on seven real‑robot tasks, surpassing the GR00T N1.7 baseline.

By Jin Lou, Jingxuan Zhu, Andong Chen, Xupeng Wang, Yuan Xu, Yuexuan Li, Xingdong Zhu, Zhijie Zhu, Yingwei Ji, Wenpeng Nie, Jingyi Li, Liangliang Chen, Jinyan Liu, Zhiqi Song, Jidong Zhang, Hongming Li, Yuchen Zhu
arXiv AI
Jun 2

Closed-Loop Neural Activation Control in Vision-Language-Action Models

arXiv:2606. 00269v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models can be steered at test time by intervening on semantically meaningful internal directions, but existing methods use a fixed steering coefficient, effectively operating in open loop.

By Abhijith Babu, Ramneet Kaur, Nathaniel D. Bastian, Olivera Kotevska, Susmit Jha, Yanzhao Wu, Sumit Kumar Jha, Anirban Roy
arXiv Computer Vision
Sep 24

CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Execution

CereVLA is a cerebellum-inspired framework that enhances vision‑language‑action (VLA) policies by adding lightweight residual refinement and predictive consequence evaluation to frozen VLA execution. It generates corrective actions via flow‑based residual refinement, then assesses their short‑ and interval‑horizon impacts using a recurrent state‑space model and a history‑aware classifier, suppressing unfavorable corrections with a lightweight governor. Experiments on LIBERO‑10, LIBERO‑GOAL, and SO‑101 show that CereVLA improves task success rates and reduces control steps compared to state‑of‑the‑art baselines.

By Shuai Zeng, Yuxuan Liang, Hangmiao Hu, Fobao Zhou, Zixiang Wang, Wenxi Hong, Hang Zhao
arXiv Machine Learning
Sep 24

VCMM: Variance-Calibrated Momentum for Multimodal Learning

VCMM: Variance-Calibrated Momentum for Multimodal Learning proposes a new optimizer that adapts momentum based on modality-specific gradient dynamics. It estimates minibatch noise and temporal drift online, using a Kalman-inspired controller to set modality-specific momentum and applies bias correction for the first moment. Experiments on four multimodal benchmarks show consistent improvements with modest training overhead.

By Zhongjing Gu, Chenyang Huang, Yufa Feng, Chong He, Qinxu Ding, Yiming Cui
arXiv AI
Jul 14

Learning Residual Kinematic Corrections for Continuous Neural Decoding via Reinforcement Learning

arXiv:2607. 11530v1 Announce Type: new Abstract: Decoding continuous three-dimensional (3D) motor imagery (MI) using non-invasive electroencephalography (EEG)-based brain--computer interfaces (BCIs) remains challenging due to signal variability and residual decoding errors.

By Jiamian Li, Niall McShane, Attila Korik, Naomi du Bois, Karl McCreadie, Leen Jabban, Benjamin Metcalfe, \"Ozg\"ur \c{S}im\c{s}ek, Damien Coyle