arXiv Computer Vision
Sep 14

Adaptive AI: Energy Efficient Multi-exit TinyML on Intelligent Vision Systems at the Edge

The paper presents a novel multi‑exit computational scheme for TinyML on an ultra‑low‑power GAP9 SoC, adding confidence‑based gating points to a MobileNetV2 CNN for ImageNet‑100. By allowing inference to stop early, the approach cuts average MAC operations by 41 % (from 313 MMAC to 185 MMAC), reduces inference time by 29 % (49 ms to 35 ms), and saves 24 % in energy (2.1 mJ to 1.6 mJ per frame) with only a ~1 % drop in accuracy. Compared to a state‑of‑the‑art adaptive CNN on the same hardware, the method more than doubles computational efficiency, raising MAC/cycle from 8.1 to 17.2.

By Luca Crupi, Lorenzo Lamberti, Alessandro Giusti, Daniele Palossi
arXiv AI
Aug 19

Adaptive AI Task Partitioning and Safe Offloading in Heterogeneous Edge-Cloud Continuum

The paper introduces a dynamic framework for partitioning neural network layers across a heterogeneous edge‑cloud continuum, adapting to runtime changes in network conditions and device capabilities. It profiles models at startup, measures link quality, and periodically re‑evaluates the partitioning to optimize performance. Experiments on a Raspberry Pi, laptop, and desktop using VGG16, AlexNet, and MobileNetV2 demonstrate energy savings of 27.09–35.82% and latency reductions of 6.34–22.92% over static partitioning.

By Akuen Akoi Deng, Eimantas Butkus, Alfreds Lapkovskis, Praveen Kumar Donta