arXiv AI

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

RobustNCL is a lightweight framework that enhances the reliability of neuromorphic continual learning (NCL) systems against transient hardware faults. It detects faults during weight access from off‑chip memory and cures affected weights using one of three strategies—zero replacement, min/max value, or most‑probable value—storing curing values in radiation‑hardened memory. Experiments on Split MNIST, Split Fashion‑MNIST, Split CIFAR‑10, and Split CIFAR‑100 show that RobustNCL maintains accuracy within 0.5% of fault‑free models and significantly outperforms baseline NCL methods while adding negligible latency and energy overhead.

arXiv AI
Oct 26

ENCL: Enabling Efficient Neuromorphic Continual Learning with Local Learning Rule and Sub-Network Freezing Strategy

ENCL is a neuromorphic continual learning method that uses a lightweight local learning rule and a sub‑network freezing strategy to train new tasks efficiently. By avoiding memory‑intensive experience replay and costly global backpropagation, ENCL reduces memory usage, training time, power, and energy consumption while maintaining competitive accuracy on task‑incremental learning benchmarks.

By Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Hassan Raza, Muhammad Shafique
Hugging Face Trending Papers
Jul 2

DeadPool: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint

State-of-the-art large language model (LLM) training takes tens of thousands of graphics processing units (GPUs) for months and encounters failures across the software and hardware stack. Existing fault-tolerance mechanisms either impose non-trivial overhead during failure-free execution or suffer from prolonged recovery latency, particularly under scenarios where a small subset of compute nodes experience permanent failures.

arXiv AI
Jul 21

The Art of Not Forgetting

arXiv:2607. 17944v1 Announce Type: cross Abstract: We introduce CMP (Cognitive Memory Primitive), an architecture that represents inputs as sparse relational codes, stores them in a two-tier competitive memory, and learns entirely through local, gradient-free updates, with no backpropagation anywhere in the network.

By Ashmith Atmuri, Akshay Kumar, Yashaswini Rao Bhogarajula
arXiv AI
Aug 26

Restoring Without Forgetting: Continual Learning Across Image Degradations

The paper introduces Restoring without Forgetting (RwF), a continual learning framework for image restoration that handles multiple degradations sequentially without accessing prior data. RwF trains a lightweight adapter for each new degradation, uses an unsupervised routing mechanism to select the correct restoration path, and achieves significant PSNR gains over fine‑tuning on five benchmark degradation domains. The method also demonstrates strong transfer performance on eleven real‑degradation datasets with high routing accuracy.

By Alif Ashrafee, Bartosz Krawczyk
arXiv Machine Learning
Oct 5

Exploring the Trade-Off Between Structured Pruning and Fault Tolerance in Deep Neural Networks for Space Applications

The study examines how reducing the width of deep neural networks through structured pruning affects their robustness to Single Event Upsets (SEUs). By iteratively pruning baseline models and conducting fault-injection tests at each stage, the authors find that while pruning increases per-inference sensitivity to bit-flips, the shorter execution time offsets this, lowering the overall SEU probability. Consequently, structured pruning can deliver energy and latency savings without compromising reliability for space-based AI systems.

By Toon Vinck, Na\"in Jonckers, Jaro De Roose, Jeffrey Prinzie, Peter Karsmakers