arXiv AI

WattLayer: Get Layers Right to Estimate Inference Energy of Neural Networks

arXiv:2606. 27841v1 Announce Type: cross Abstract: The widespread adoption of Artificial Intelligence (AI) has led to increasing concerns about energy consumption, yet there is a lack of standardized methodologies to accurately estimate AI inference energy consumption, particularly across various tasks and architectures.

arXiv Machine Learning
Jun 30

Harvesting AI Computation at the Edge via Generic Approximation

arXiv:2606. 29518v1 Announce Type: cross Abstract: With the widespread adoption of AI in various IoT scenarios such as smart sensing and processing, AI chips have become a common component at the edge.

By Yihan Wang, Huiru Yan, Luxin Zhang, Long Cheng, Weiwei Chen, Ying Wang, Lei Zhang, Cheng Liu, Huawei Li
arXiv AI
Jul 28

OrchNAS: Orchestrated Neural Architecture Search Service for Personalised Federated Edge Intelligence

arXiv:2607. 22805v1 Announce Type: cross Abstract: We propose OrchNAS, an energy-aware, personalised, federated edge intelligence framework that leverages a Neural Architecture Search Service to automatically design service-adaptive models for heterogeneous edge environments.

By Keya Patel, Sajib Mistry, Sheik Mohammad Mostakim Fattah, Aneesh Krishna
arXiv AI
Aug 28

The Accuracy-Efficiency Paradox Quantifying Net Energy Loss in on-Device Energy Forecasting

The paper titled "The Accuracy-Efficiency Paradox Quantifying Net Energy Loss in on-Device Energy Forecasting" discusses how highly accurate energy forecasting models can paradoxically cause a net energy deficit on edge devices due to inference energy consumption and battery aging. It introduces a Total Cost of Ownership (TCO) framework that unifies inference energy and battery degradation as forms of energy loss, aiming to minimize net energy loss. Experiments show that in thermally sensitive edge environments, the energy saved by more precise, complex models is often offset by the higher operational intensity they require.

By Jaeik Jeong, Tai-Yeon Ku, Wan-Ki Park
Hugging Face Trending Papers
Jul 24

OrchNAS: Orchestrated Neural Architecture Search Service for Personalised Federated Edge Intelligence

We propose OrchNAS, an energy-aware, personalised, federated edge intelligence framework that leverages a Neural Architecture Search Service to automatically design service-adaptive models for heterogeneous edge environments. The framework orchestrates the architecture search process on a server-side NAS service, enabling edge services to derive personalised architectures under device-level energy, computation, and memory constraints.

arXiv Machine Learning
Aug 31

Node-wise Feature Encoding for Neural Performance Prediction

FeatureFormer is a neural performance predictor that adds explicit node-wise encodings of FLOPs, parameter counts, and memory proxies to a gated graph attention architecture. It is designed to improve latency and energy prediction for neural networks on edge devices, addressing the limitation of existing GNN and transformer predictors that largely ignore node-level computational cost. The authors also introduce NNEQ, a large-scale energy consumption dataset, and show through extensive experiments that FeatureFormer achieves state‑of‑the‑art performance across both metrics, including challenging out‑of‑domain settings, while the encoding can broadly enhance existing predictors with negligible overhead.

By Matthew Grenier, William Hammer, Andrew Heuer, Nikhil Krishna, Yi Wang, Ramtin Zand
arXiv AI
Aug 25

Power-Performance Characterization of TinyML Systems

arXiv:2608.21646v1 Announce Type: cross Abstract: TinyML systems are enabling machine learning (ML) inference at the edge. However, there is little quantitative analysis of such systems. This paper p...

By Yujie Zhang, Dhananjaya Wijerathne, Zhaoying Li, Tulika Mitra
arXiv AI
Aug 19

Adaptive AI Task Partitioning and Safe Offloading in Heterogeneous Edge-Cloud Continuum

The paper introduces a dynamic framework for partitioning neural network layers across a heterogeneous edge‑cloud continuum, adapting to runtime changes in network conditions and device capabilities. It profiles models at startup, measures link quality, and periodically re‑evaluates the partitioning to optimize performance. Experiments on a Raspberry Pi, laptop, and desktop using VGG16, AlexNet, and MobileNetV2 demonstrate energy savings of 27.09–35.82% and latency reductions of 6.34–22.92% over static partitioning.

By Akuen Akoi Deng, Eimantas Butkus, Alfreds Lapkovskis, Praveen Kumar Donta
arXiv Machine Learning
Jul 13

A Survey on the Green Development of Large Models: From Resource-Efficient Architectures to Hardware-Software Co-Design

arXiv:2607. 09084v1 Announce Type: new Abstract: The rapid expansion of large-scale AI models has led to significant performance breakthroughs across diverse domains, yet it has also raised critical concerns regarding computational costs, energy consumption, and environmental sustainability.

By Linhui Xiao, Guiping Cao, Mingyue Guo, Xianchao Guan, Fan Yang, Ming Tao, Xin Li, Yuxin Peng, Yaowei Wang