arXiv Machine Learning

A Radiation-Hardened, Fault-Aware Quantized Neural Network That Self-Heals

arXiv AI
Jul 7

From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips

arXiv:2603. 22770v2 Announce Type: replace-cross Abstract: The deployment of deep neural networks (DNNs) in safety-critical edge environments necessitates robustness against hardware-induced bit-flip errors.

By Alan T. L. Bacellar, Sathvik Chemudupati, Shashank Nag, Allison Seigler, Priscila M. V. Lima, Felipe M. G. Fran\c{c}a, Lizy K. John
arXiv AI
Oct 26

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

RobustNCL is a lightweight framework that enhances the reliability of neuromorphic continual learning (NCL) systems against transient hardware faults. It detects faults during weight access from off‑chip memory and cures affected weights using one of three strategies—zero replacement, min/max value, or most‑probable value—storing curing values in radiation‑hardened memory. Experiments on Split MNIST, Split Fashion‑MNIST, Split CIFAR‑10, and Split CIFAR‑100 show that RobustNCL maintains accuracy within 0.5% of fault‑free models and significantly outperforms baseline NCL methods while adding negligible latency and energy overhead.

By Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Muhammad Shafique
arXiv AI
Jun 4

Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data

arXiv:2606. 04238v1 Announce Type: cross Abstract: Aggressive weight quantization to 2-bit precision offers substantial throughput and memory gains for large language model (LLM) inference, but typically incurs severe accuracy degradation.

By Devleena Das, Rajeev Patwari, Elliott Delaye, Ashish Sirasao
arXiv Machine Learning
Oct 5

Exploring the Trade-Off Between Structured Pruning and Fault Tolerance in Deep Neural Networks for Space Applications

The study examines how reducing the width of deep neural networks through structured pruning affects their robustness to Single Event Upsets (SEUs). By iteratively pruning baseline models and conducting fault-injection tests at each stage, the authors find that while pruning increases per-inference sensitivity to bit-flips, the shorter execution time offsets this, lowering the overall SEU probability. Consequently, structured pruning can deliver energy and latency savings without compromising reliability for space-based AI systems.

By Toon Vinck, Na\"in Jonckers, Jaro De Roose, Jeffrey Prinzie, Peter Karsmakers
arXiv Machine Learning
Sep 24

RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

The paper introduces RAMP, a method for robust adaptive mixed‑precision quantization of vision models on edge CPUs. It evaluates 13 sensitivity metrics across four neural networks, finding that Jensen‑Shannon Divergence consistently identifies layers that can be safely quantized. Using K‑Means clustering on these metrics, RAMP achieves near‑lossless accuracy with an average 1.81× speed‑up, while cautioning against excluding low‑speed‑up layers that can fragment the computational graph.

By David Poblaci\'on-Criado, Dario Garcia-Gasulla, Eduardo Quinones
arXiv AI
Sep 17

REQAP: Resilient Weight Packing and Quantization for Edge DNN Acceleration

The paper introduces REQAP, a reliability‑aware quantized weight packing technique for systolic‑array DNN accelerators. It uses a sensitivity‑driven mixed‑precision quantization to assign layer‑wise bit‑widths, a deterministic register‑level packing strategy for SIMD‑within‑a‑register execution, and selective bit‑level protection that replicates critical MSBs into unused register space. Experiments on AlexNet, VGG‑11, and ResNet‑18 show up to 62% memory reduction, 56% fewer MAC operations, and improved accuracy resilience under fault injection compared to baseline and fully protected models.

By Mahdi Taheri, Samira Nazari, Mubassher Ansari, Ali Azarpeyvand, Mohsen Afsharchi, Maksim Jenihhin, Christian Herglotz
arXiv AI
Sep 7

TreeFI: Value-Aware Statistical Fault Injection for Deep Neural Networks

TreeFI is a value‑aware statistical fault‑injection technique for FP32 single‑bit faults in deep neural network activations and weights. It partitions each layer’s value distribution into intervals with similar expected bit‑flip behavior using regression trees, then allocates injections across these intervals based on their relevance for failure‑rate estimation. This stratified approach preserves target confidence and error margins while dramatically reducing the required injection budget—up to 72.1× for activations and 11.2× for weights compared to existing baselines.

By Noam Bires, Marcello Traiola, Angeliki Kritikakou, Elisa Fromont