arXiv Machine Learning

Repair Brain Damage: Real-Numbered Error Correction Code for Neural Network

The paper introduces a real-valued error correction coding framework for neural networks that detects and corrects both memory faults and computational errors. It imposes structured linear constraints on network weights, allowing efficient error detection and recovery without adding parameters or hurting classification performance. The method uses linear programming and sparse recovery to keep error correction low‑complexity, and is claimed to be the first real‑number‑based ECC scheme addressing both error types simultaneously.

arXiv AI
Jul 7

From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips

arXiv:2603. 22770v2 Announce Type: replace-cross Abstract: The deployment of deep neural networks (DNNs) in safety-critical edge environments necessitates robustness against hardware-induced bit-flip errors.

By Alan T. L. Bacellar, Sathvik Chemudupati, Shashank Nag, Allison Seigler, Priscila M. V. Lima, Felipe M. G. Fran\c{c}a, Lizy K. John
arXiv Machine Learning
Sep 21

Layerwise Decoupling for Stable Structured Sparsification of Fully Connected Layers

The paper introduces a layerwise, decoupled approach to structurally sparsify fully connected layers in pretrained neural networks. By extracting shallow two‑layer subnetworks, normalizing inner weights, and applying a structured group penalty to each block’s outer weight matrix, the method prunes neurons sequentially and reduces layer widths. The authors prove equivalence to a joint penalty for positively homogeneous activations, and demonstrate that this decoupled formulation is more robust, offering a broader regularization range and lower catastrophic over‑pruning while preserving accuracy in classification, sparse‑recovery, PINN, and OPT‑1.3B experiments.

By Charles Kulick, Armenak Petrosyan, Sui Tang
arXiv AI
Oct 26

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

RobustNCL is a lightweight framework that enhances the reliability of neuromorphic continual learning (NCL) systems against transient hardware faults. It detects faults during weight access from off‑chip memory and cures affected weights using one of three strategies—zero replacement, min/max value, or most‑probable value—storing curing values in radiation‑hardened memory. Experiments on Split MNIST, Split Fashion‑MNIST, Split CIFAR‑10, and Split CIFAR‑100 show that RobustNCL maintains accuracy within 0.5% of fault‑free models and significantly outperforms baseline NCL methods while adding negligible latency and energy overhead.

By Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Muhammad Shafique
arXiv AI
Jun 9

ePC: Fast and Deep Predictive Coding in Digital Simulation

arXiv:2505. 20137v5 Announce Type: replace-cross Abstract: Predictive Coding (PC) offers a brain-inspired alternative to backpropagation for neural network training, described as a physical system minimizing its internal energy.

By C\'edric Goemaere, Gaspard Oliviers, Rafal Bogacz, Thomas Demeester