arXiv AI By Fanqi Yu, Matteo Tiezzi, Cigdem Beyan, Tommaso Apicella, Vittorio Murino

HIDRA: Hierarchical Dual-Routing Attention for Replay-Free Lifelong Imitation Learning

Read the original on arXiv AI →

HIDRA is a hierarchical dual-routing attention framework designed for replay‑free lifelong imitation learning in robotics. It separates instruction‑level expert retrieval from context‑dependent refinement and adds key‑level geometric regularization to keep tasks aligned yet distinct, thereby reducing routing interference. Experiments on LIBERO benchmarks show that HIDRA outperforms both replay‑free and replay‑based baselines, improving AUC, forward transfer, and maintaining low forgetting, especially under high interference and language variation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Aug 27

SAME: Stabilized Mixture-of-Experts for Multimodal Continual Instruction Tuning

The paper introduces SAME (Stabilized Mixture-of-Experts) to address challenges in Multimodal Continual Instruction Tuning (MCIT) for large language models. SAME mitigates router drift by decomposing routing dynamics into orthogonal subspaces and updating only task-relevant directions, while preventing expert drift through curvature‑aware scaling that uses historical input covariance without rehearsal. The method also employs adaptive expert activation to freeze selected experts during training, reducing redundant computation and cross‑task interference, and demonstrates state‑of‑the‑art performance on a new long‑task‑sequence benchmark.

By Zhen-Hao Xie, Jun-Tao Tang, Yu-Cheng Shi, Han-Jia Ye, De-Chuan Zhan, Da-Wei Zhou
arXiv Computer Vision
Aug 21

OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation

arXiv:2608. 19589v1 Announce Type: cross Abstract: Pretrained Vision-Language-Action models provide a strong foundation for robot learning, but sequentially adapting them to diverse skills can perturb the representations and velocity mappings used by previous skills, leading to catastrophic forgetting.

By Jiaqi Wang, Zhou Fang, Qiongfeng Shi, Yi Zhou
arXiv AI
Oct 5

RIFAR: Reliability and Forgetting-Aware Replay for Continual Robot Learning

RIFAR is a new continual learning method for robots that uses reliability screening and drift-aware replay to mitigate forgetting while keeping storage low. It reconstructs past trajectories from short demonstration prefixes and employs a frozen inverse-dynamics model to verify action‑visual consistency. In experiments on LIBERO suites and real‑world tasks, RIFAR outperforms previous generative replay approaches, achieving high performance with only a small fraction of stored steps.

By Zirong Song, Zheng Lu, Haoran Liao, Wanqi Zhong, Yunhe Ni, Lijie Wang, Xiuying Chen