arXiv AI

An Empirical Fault Vulnerability Exploration of ReRAM-based Process-in-Memory CNN Accelerators

arXiv Machine Learning
Aug 6

Understanding Fault Tolerance of Adversarially Robust Pruned Models

arXiv:2608. 04173v1 Announce Type: new Abstract: Deep neural networks (DNNs) deployed on resource-constrained neuromorphic hardware face three concurrent challenges: the need for model compression through pruning, vulnerability to adversarial input perturbations, and susceptibility to hardware-induced weight faults such as stuck-at-zero errors.

By Manali Dangarikar, Cory Merkel
arXiv AI
Jul 7

From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips

arXiv:2603. 22770v2 Announce Type: replace-cross Abstract: The deployment of deep neural networks (DNNs) in safety-critical edge environments necessitates robustness against hardware-induced bit-flip errors.

By Alan T. L. Bacellar, Sathvik Chemudupati, Shashank Nag, Allison Seigler, Priscila M. V. Lima, Felipe M. G. Fran\c{c}a, Lizy K. John
arXiv Computer Vision
Oct 2

Right In-Place (RiP) Convolution: A Simple, General, and Near-Optimal Strategy for Memory-Efficient CNN Inference

The paper introduces Right In-Place (RiP) convolution, a memory‑efficient strategy that corrects and generalizes previous in‑place convolution formulations to arbitrary stride, dilation, padding, and rectangular kernels. RiP aligns each layer’s input and output within a shared workspace, enabling safe, row‑major access with minimal memory overhead. Experiments on 10,000 random layers and 84 layers from 25 architectures show no corruption, matching or improving on existing herringbone workspaces while reducing memory usage by up to 24.8% and lowering peak activation memory on Raspberry Pi Pico MCUs by 12.5–33.3% without affecting cycle counts.

By Opegbemi Matthias Busoye, Tolulope Matthew Busoye, Eghonghon-aye Eigbe
arXiv AI
1d ago

Analysis of LLM Vulnerability to GPU Soft Errors: An Instruction-Level Fault Injection Study

The paper presents the first instruction-level fault injection study of large language model (LLM) inference, focusing on how GPU soft errors affect these compute- and memory-intensive models. It examines the impact of model architecture, parameter scale, and task complexity on LLM vulnerability, revealing distinct reliability characteristics compared to earlier neural networks. The study offers new insights that can guide the development of more effective fault tolerance mechanisms for LLMs.

By Duo Chai, Zizhen Liu, Shuhuai Wang, Songwei Pei, Cheng Liu, Huawei Li, Shangguang Wang
arXiv AI
Oct 26

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

RobustNCL is a lightweight framework that enhances the reliability of neuromorphic continual learning (NCL) systems against transient hardware faults. It detects faults during weight access from off‑chip memory and cures affected weights using one of three strategies—zero replacement, min/max value, or most‑probable value—storing curing values in radiation‑hardened memory. Experiments on Split MNIST, Split Fashion‑MNIST, Split CIFAR‑10, and Split CIFAR‑100 show that RobustNCL maintains accuracy within 0.5% of fault‑free models and significantly outperforms baseline NCL methods while adding negligible latency and energy overhead.

By Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Muhammad Shafique
arXiv AI
Sep 7

TreeFI: Value-Aware Statistical Fault Injection for Deep Neural Networks

TreeFI is a value‑aware statistical fault‑injection technique for FP32 single‑bit faults in deep neural network activations and weights. It partitions each layer’s value distribution into intervals with similar expected bit‑flip behavior using regression trees, then allocates injections across these intervals based on their relevance for failure‑rate estimation. This stratified approach preserves target confidence and error margins while dramatically reducing the required injection budget—up to 72.1× for activations and 11.2× for weights compared to existing baselines.

By Noam Bires, Marcello Traiola, Angeliki Kritikakou, Elisa Fromont
arXiv Machine Learning
Aug 24

Faults That Fortify: CNN Adversarial Robustness via GPU Undervolting

The paper demonstrates that undervolting GPUs during CNN training introduces stochastic faults that act as implicit regularization, improving adversarial robustness while reducing power consumption. Experiments on LeNet, VGG-6, and MobileNetV3 trained on MNIST and CIFAR-10 show that undervolted models consistently outperform nominal-voltage models in both standard and adversarial training regimes. The approach offers a hardware-level defense that requires no algorithmic changes and yields significant energy savings due to the quadratic relationship between dynamic power and supply voltage.

By Behnam Omidi, Ahmad Tahmasivand, Husam Alsyouri, Saba Al-Sayouri, Chongzhou Fang, Ihsen Alouani, Khaled N. Khasawneh
arXiv Machine Learning
Oct 5

Exploring the Trade-Off Between Structured Pruning and Fault Tolerance in Deep Neural Networks for Space Applications

The study examines how reducing the width of deep neural networks through structured pruning affects their robustness to Single Event Upsets (SEUs). By iteratively pruning baseline models and conducting fault-injection tests at each stage, the authors find that while pruning increases per-inference sensitivity to bit-flips, the shorter execution time offsets this, lowering the overall SEU probability. Consequently, structured pruning can deliver energy and latency savings without compromising reliability for space-based AI systems.

By Toon Vinck, Na\"in Jonckers, Jaro De Roose, Jeffrey Prinzie, Peter Karsmakers