arXiv AI

Accuracy and Robustness of Model Cascades Under Data Perturbations

The paper investigates how confidence‑based model cascades, which route easy inputs to lightweight models and defer difficult cases to larger ones, behave under data perturbations. It shows that static corruptions can either break the routing signal or degrade both models, while sequential perturbations cause predictions to stabilize but deferral to fail, revealing three distinct failure modes. The study highlights that energy‑efficient cascades must be evaluated not only on clean accuracy but also on routing reliability when the input distribution shifts.

arXiv AI
Sep 12

Calibration-Aware Uncertainty Cascades for Efficient Heterogeneous Model Collaboration

The paper introduces Calibration-Aware Uncertainty Cascades (CAUC), a post‑hoc framework that calibrates each model’s confidence independently and uses these calibrated scores to decide when to accept an early prediction, invoke a stronger model, or combine outputs. CAUC establishes a common reliability scale across heterogeneous models, decoupling deployment policies from specific model pools or budgets. Experiments on six language benchmarks show a 1.9% relative accuracy gain over strong‑model‑only inference while cutting strong‑model calls by about 47%, and on image classification it maintains or improves performance while reducing GFLOPs by up to 57%.

By Yilin Zhang, Han Jiang, Cai Xu, Ying Liu, Wei Zhao
arXiv AI
Sep 17

Reliable Virtual Sensing: A Multi-Domain Benchmark for Robustness Under Sensor Failures

The paper introduces MuViS-C, a multi‑domain benchmark that evaluates the robustness of learning‑based virtual sensing models against ten common sensor failure modes, ranging from subtle drifts to catastrophic dropouts. It assesses models using average error, relative degradation, and worst‑case fragility across nine datasets from six domains, comparing six architectures (gradient‑boosted trees, convolution, recurrence, attention, and MLP‑mixing). The study finds that all models degrade under corruption, gradient‑boosted trees are most robust, and targeted robustification can improve attention models at the cost of nominal performance.

By Jens U. Brandt, Noah C. Puetz, Alexander Windmann, Marc Hilbert, Elena Raponi, Thomas B\"ack, Thomas Bartz-Beielstein
arXiv Computer Vision
Sep 15

Sparsity-Adaptive Sharpness-Aware Minimization

The paper introduces Sparsity-Adaptive Sharpness-Aware Minimization (SA‑SAM), a method that adjusts the perturbation radius in sharpness-aware training to remain consistent as model sparsity increases. It also evaluates a Magnitude‑Weighted Hessian (MWH) importance metric derived from second‑order analysis. Experiments on CIFAR‑10‑C, CIFAR‑100‑C, and ImageNet‑100‑C show that SA‑SAM improves corruption robustness at 80–90% sparsity while maintaining clean accuracy, and the study reports inference throughput at deployment‑relevant sparsity levels.

By Shiryu Ueno, Yoshikazu Hayashi, Kunihito Kato
arXiv AI
Jun 9

A Mechanistic Analysis of Adversarial Fine-tuning of Vision Transformers

arXiv:2606. 07593v1 Announce Type: cross Abstract: The widespread use of image classification models in high-risk, real-world situations necessitates making these models robust to slight disturbances or perturbations, such as blurring or sharpening, in the input images.

By Hannah Gao (Massachusetts Institute of Technology), Isha Agarwal (Massachusetts Institute of Technology), Dylan Hadfield-Menell (Massachusetts Institute of Technology), Rachel Ma (Massachusetts Institute of Technology)
arXiv AI
Aug 28

The Accuracy-Efficiency Paradox Quantifying Net Energy Loss in on-Device Energy Forecasting

The paper titled "The Accuracy-Efficiency Paradox Quantifying Net Energy Loss in on-Device Energy Forecasting" discusses how highly accurate energy forecasting models can paradoxically cause a net energy deficit on edge devices due to inference energy consumption and battery aging. It introduces a Total Cost of Ownership (TCO) framework that unifies inference energy and battery degradation as forms of energy loss, aiming to minimize net energy loss. Experiments show that in thermally sensitive edge environments, the energy saved by more precise, complex models is often offset by the higher operational intensity they require.

By Jaeik Jeong, Tai-Yeon Ku, Wan-Ki Park