arXiv AI

Efficient Leakage-Free Neural Architecture Search under Leave-One-Subject-Out Evaluation

The paper introduces a leakage‑free, block‑based method for Neural Architecture Search (NAS) that shares runs across subjects, thereby avoiding the quadratic cost of a fully nested Leave‑One‑Subject‑Out (LOSO) evaluation. Applied to the BioVid Heat Pain dataset, the approach raises mean accuracy from 82.79 % to 83.39 % and can cut model parameters by up to 99.2 %.

arXiv Machine Learning
Aug 27

ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures

ONNX-Net introduces a universal representation for neural architectures using natural language descriptions, enabling instant performance prediction across diverse search spaces. The authors present ONNX-Bench, a benchmark of over 600k architecture–accuracy pairs compiled from open‑source NAS‑bench networks in ONNX format. Experiments demonstrate strong zero‑shot predictive performance with minimal pretraining, overcoming the limitations of cell‑based, graph‑encoded approaches.

By Shiwen Qin, Alexander Auras, Shay B. Cohen, Elliot J. Crowley, Michael Moeller, Linus Ericsson, Jovita Lukasik
Hugging Face Trending Papers
5d ago

AutoBCI: Forecast-Guided Agentic Neural Architecture Discovery for EEG-Based Brain--Computer Interfaces

AutoBCI is an agentic framework that uses a Designer Agent and a Forecaster Agent to discover and select EEG decoding architectures across diverse tasks such as emotion recognition, motor imagery, and sleep staging. The Designer Agent performs Pool‑Guided Architecture Discovery (PGAD) to generate and refine models, while the Forecaster Agent uses Performance Estimation from Early Knowledge (PEEK) to predict full‑budget validation performance from early learning curves. In experiments on 14 EEG datasets, AutoBCI with Claude Opus 5.5 achieved a 64.16% average test balanced accuracy, slightly surpassing the best baseline, and PEEK reduced prediction error by 38.1% compared to the best-observed-score baseline.

arXiv AI
6d ago

Models Got Talent: Identifying High Performing Wearable Human Activity Recognition Models Without Training

The paper investigates the use of Zero Cost Proxies (ZCPs) to identify high‑performing wearable Human Activity Recognition (HAR) models without full training. Eight ZCPs were evaluated across six benchmark HAR datasets, showing that the top‑predicted architectures achieve performance within 7% of fully trained models, and training the top‑10 predictions reaches within 2% of full training. This demonstrates that ZCPs can significantly reduce computational costs while maintaining competitive accuracy in sensor‑based HAR tasks.

By Richard Goldman, Varun Komperla, Thomas Ploetz, Harish Haresamudram
arXiv Machine Learning
1d ago

Prediction-powered Neural Architecture Search

The paper introduces PPNAS, a prediction‑powered inference method for neural architecture search that combines a small set of accurately evaluated architectures with a large set of zero‑cost proxy (ZCP) evaluations. PPNAS uses the ordinal information from ZCPs to generate pairwise ranking supervision and applies a debiasing step to reconcile discrepancies between proxy and true performance rankings. Experiments show that PPNAS achieves state‑of‑the‑art results in predictor‑based NAS under limited evaluation budgets.

By Pascal Janetzky, Yuxin Wang, Michael Klar, Stefan Feuerriegel