arXiv Machine Learning

Efficient Architecture Search under Leave-One-Subject-Out Evaluation

arXiv AI
Sep 11

Efficient Leakage-Free Neural Architecture Search under Leave-One-Subject-Out Evaluation

The paper introduces a leakage‑free, block‑based method for Neural Architecture Search (NAS) that shares runs across subjects, thereby avoiding the quadratic cost of a fully nested Leave‑One‑Subject‑Out (LOSO) evaluation. Applied to the BioVid Heat Pain dataset, the approach raises mean accuracy from 82.79 % to 83.39 % and can cut model parameters by up to 99.2 %.

By Heinke Hihn
Hugging Face Trending Papers
Jul 22

An Exploratory Analysis of Pain Localization via Explainable Computational Modeling

Automatic pain localization, which involves identifying the anatomical origin of pain from peripheral physiological signals without patient self-report, is a clinically critical but largely unaddressed problem, particularly for non-verbal patients. This paper presents a systematic comparison of classical feature engineering and deep sequence learning for subject-independent three-class pain localization using the AI4Pain 2026 Challenge dataset, which comprises four synchronously recorded wearable modalities: electrodermal activity, blood volume pulse, respiration, and peripheral oxygen saturation recorded from 65 participants under controlled TENS-induced pain.

arXiv Machine Learning
Aug 27

ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures

ONNX-Net introduces a universal representation for neural architectures using natural language descriptions, enabling instant performance prediction across diverse search spaces. The authors present ONNX-Bench, a benchmark of over 600k architecture–accuracy pairs compiled from open‑source NAS‑bench networks in ONNX format. Experiments demonstrate strong zero‑shot predictive performance with minimal pretraining, overcoming the limitations of cell‑based, graph‑encoded approaches.

By Shiwen Qin, Alexander Auras, Shay B. Cohen, Elliot J. Crowley, Michael Moeller, Linus Ericsson, Jovita Lukasik
arXiv AI
Jun 8

LuMamba: Latent Unified Mamba for Electrode Topology-Invariant and Efficient EEG Modeling

arXiv:2603. 19100v2 Announce Type: replace Abstract: Electroencephalography (EEG) enables non-invasive monitoring of brain activity across clinical and neurotechnology applications, yet building foundation models for EEG remains challenging due to differing electrode topologies and computational scalability, as Transformer architectures incur quadratic sequence complexity.

By Dana\'e Broustail, Anna Tegon, Thorir Mar Ingolfsson, Yawei Li, Luca Benini
arXiv AI
6d ago

Models Got Talent: Identifying High Performing Wearable Human Activity Recognition Models Without Training

The paper investigates the use of Zero Cost Proxies (ZCPs) to identify high‑performing wearable Human Activity Recognition (HAR) models without full training. Eight ZCPs were evaluated across six benchmark HAR datasets, showing that the top‑predicted architectures achieve performance within 7% of fully trained models, and training the top‑10 predictions reaches within 2% of full training. This demonstrates that ZCPs can significantly reduce computational costs while maintaining competitive accuracy in sensor‑based HAR tasks.

By Richard Goldman, Varun Komperla, Thomas Ploetz, Harish Haresamudram
arXiv AI
Sep 17

NeuroSketch: A Practical Design Recipe for Neural Decoding

NeuroSketch presents a practical design recipe for neural decoding, beginning with a comparative study of nine basic architectures that identifies CNN‑2D as the most effective. The recipe incorporates macro‑level gradual feature‑map expansion and early downsampling, along with micro‑level grouped convolutions, resulting in two variants—NeuroSketch‑Base (1.4M parameters) and NeuroSketch‑Large (4.2M parameters). Across nearly 5,000 experiments on eight tasks involving visual, auditory, and speech modalities and EEG, SEEG, and ECoG signals, both variants outperform ten baseline models on every task.

By Gaorui Zhang, Zhizhang Yuan, Jialan Yang, Junru Chen, Fanqi Shen, Li Meng, Yang Yang