Co2In is a bi‑level memory incremental learning framework that mimics human memory mechanisms. It uses a working memory to encode new knowledge and a long‑term memory to retain it, with a consolidation step that extracts patterns and compresses them into a compact representation. Experiments on CIFAR‑10, CIFAR‑100, and Tiny‑ImageNet demonstrate state‑of‑the‑art performance while keeping memory usage efficient.
arXiv:2608. 04358v1 Announce Type: new Abstract: Continual learning (CL) requires models to learn tasks sequentially, yet deep neural networks often suffer from plasticity loss and poor knowledge transfer, which can impede their long-term adaptability.
arXiv:2609.37702v1 Announce Type: cross Abstract: Class Incremental Learning (Class-IL) requires models to learn new classes over time while preserving previously acquired knowledge without access to...
arXiv:2604. 27031v2 Announce Type: replace-cross Abstract: In a continual learning setting, we require a model to be plastic enough to learn a new task and stable enough to not disturb previously learned capabilities.
arXiv:2608. 19514v1 Announce Type: cross Abstract: Persistent intelligent systems require the ability to learn continually, but current machine learning approaches face significant challenges in this area compared to biological learning systems.
arXiv:2603. 01761v2 Announce Type: replace-cross Abstract: Foundation models have transformed machine learning through large-scale pretraining and increased test-time compute.
arXiv:2605. 13438v3 Announce Type: replace Abstract: Existing agent memory remains predominantly reactive and retrieval-based, lacking the capacity to autonomously organize experience into persistent cognitive structure.
arXiv:2512. 03627v2 Announce Type: replace Abstract: Despite rapid progress in large-scale language and vision models, AI agents still suffer from a fundamental limitation: they cannot remember.
arXiv:2603. 25157v2 Announce Type: replace Abstract: Recent vision and multimodal foundation backbones, such as Transformer families and state-space models like Mamba, have achieved remarkable progress, enabling unified modeling across images, text, and beyond.
arXiv:2604. 27707v2 Announce Type: replace Abstract: Current agentic memory systems (vector stores, retrieval-augmented generation, scratchpads, and context-window management) do not implement memory: they implement lookup.
The paper introduces the Continuous Memory Machine (CMM), a recurrent neural network that uses separate matrix-valued short‑term and long‑term memory states. Short‑term memory tracks recent neural activity with neuron‑level models for rapid computation, while long‑term memory stores information for later use; both are jointly updated by a Transformer that allows bidirectional read‑write operations. Experiments on algorithmic, in‑context learning, and recurrent reasoning tasks show that CMM outperforms many baselines and generalizes better than previous memory‑augmented networks, while maintaining interpretable attention patterns from the Continuous Thought Machine.
arXiv:2610.19366v1 Announce Type: cross Abstract: Multimodal models and agents have emerged to enable AI systems to learn from and interact with the real world more like humans by integrating informa...
The paper investigates how multi‑neuromodulatory dynamics—driven by dopamine, acetylcholine, serotonin, and noradrenaline—can improve artificial neural networks’ continuous adaptive learning and mitigate catastrophic forgetting. It demonstrates that neuromodulators interact across multiple spatial and temporal scales, creating a complex many‑to‑many mapping between neuromodulators and tasks. The authors propose neuromodulation‑aware learning rules, architectural formulations, and a conceptual Go/No‑Go study to illustrate how biologically inspired mechanisms can enhance ANN robustness and adaptability.