NeuCME: Toward Dynamic Multimodal Continual Learning via Neural Combinatorics of Multiple Experts
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2605. 20247v2 Announce Type: replace-cross Abstract: Catastrophic forgetting remains a major obstacle to continual learning in large language models (LLMs) and vision--language models (VLMs).
arXiv:2607. 27260v1 Announce Type: new Abstract: Multimodal continual learning (MMCL) aims to learn emerging knowledge from multimodal data while preserving knowledge.
arXiv:2607. 20511v1 Announce Type: new Abstract: Multimodal Continual Instruction Tuning (MCIT) is crucial for adapting Multimodal Large Language Models (MLLMs) to evolving a sequence of downstream tasks.
The paper introduces UniDecouple, a selective decoupling framework for continual learning in unified multimodal models that addresses Task Objective Conflict (TOC). By employing a Task-Aware Mixture-of-Experts (TA‑MoE) architecture, it retains shared attention layers while adding task‑specific feed‑forward network experts to reduce optimization conflicts. Hierarchical expert routing and hybrid collaboration further balance task specialization with cross‑task knowledge sharing, and a two‑stage training strategy enhances both multimodal understanding and image generation performance.
arXiv:2512. 03627v2 Announce Type: replace Abstract: Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember.
arXiv:2607. 02020v1 Announce Type: new Abstract: Multimodal large language models must continually adapt to evolving tasks and domains, yet standard continual learning metrics mainly measure whether old answers remain correct, leaving the stability of multimodal grounding largely unexamined.