arXiv Machine Learning

DIFFNAS: Predictor-Free Neural Architecture Search via Diffusion Model and Zero-Cost Evaluation

DIFFNAS is a new neural architecture search framework that eliminates the need for performance predictors by using a discrete graph diffusion model conditioned on zero‑cost performance proxies such as MeCo and SWAP. The method achieves state‑of‑the‑art results on NAS‑Bench‑201 for CIFAR‑10 and CIFAR‑100, matching optimal architectures while cutting search cost by up to 17.5× compared to DiffusionNAG. Although its accuracy on the MobileNetV3 search space is lower than DiffusionNAG, the results demonstrate the potential of diffusion models combined with training‑free metrics for scalable architecture search.

arXiv Machine Learning
Aug 27

ONNX-Net: Towards Universal Representations and Instant Performance Prediction for Neural Architectures

ONNX-Net introduces a universal representation for neural architectures using natural language descriptions, enabling instant performance prediction across diverse search spaces. The authors present ONNX-Bench, a benchmark of over 600k architecture–accuracy pairs compiled from open‑source NAS‑bench networks in ONNX format. Experiments demonstrate strong zero‑shot predictive performance with minimal pretraining, overcoming the limitations of cell‑based, graph‑encoded approaches.

By Shiwen Qin, Alexander Auras, Shay B. Cohen, Elliot J. Crowley, Michael Moeller, Linus Ericsson, Jovita Lukasik
arXiv Machine Learning
Jul 14

HiFi-LLP: High-Fidelity, Low-Cost Latency Predictors with Confidence for Robust HW-NAS

arXiv:2607. 11746v1 Announce Type: new Abstract: With deep neural networks (DNNs) increasingly deployed on edge devices, hardware (HW)-aware optimization techniques--such as HW-aware compression and HW-aware neural architecture search (HW-NAS)--have become essential.

By Shambhavi Balamuthu Sampath, Behzad Shomali, Nael Fasfous, Moritz Thoma, Judeson Anthony Fernando, Lukas Frickenstein, Pierpaolo Mori, Manoj Rohit Vemparala, Alexander Frickenstein, Walter Stechele
arXiv Machine Learning
Oct 8

Node-level Graph Neural Architecture Search Framework

The paper introduces N-GNAS, a Node-Level Graph Neural Architecture Search framework that selects distinct network architectures for different node subsets during feature updates. It incorporates a contrastive learning loss to better separate features across categories. Experiments on eight node and graph classification datasets show that N-GNAS outperforms existing GNAS methods and hand‑crafted GNNs, achieving 78.26% accuracy on CiteSeer.

By Lintao Yanga, Sirui Lia, Yaqing Wang, Pietro Li\`o, Xu Shen, Baisong Liu, Chengbin Peng
arXiv AI
Oct 28

MIDAS: Mosaic Input-Specific Differentiable Architecture Search

MIDAS is a differentiable neural architecture search method that replaces static architecture parameters with dynamic, input‑specific parameters generated through self‑attention. It localizes architecture selection to each spatial patch of the activation map and introduces a parameter‑free, topology‑aware search space that models two‑edge node topology. Evaluations on DARTS, NAS‑Bench‑201, and RDARTS show that MIDAS achieves state‑of‑the‑art accuracy on CIFAR‑10 and CIFAR‑100 and discovers optimal or near‑optimal architectures in benchmark spaces.

By Konstanty Subbotko
arXiv Machine Learning
Jun 8

pTNAS: Progressive Neural Architecture Search for Tabular Data

arXiv:2403. 10318v3 Announce Type: replace Abstract: Recent advances have shifted the paradigm of tabular learning toward tabular foundation models, yet their accuracy relies on a heavy inference cost that scales poorly with context size.

By Naili Xing, Shaofeng Cai, Lingze Zeng, Jiaqi Zhu, Peng Lu, Jian Pei, Beng Chin Ooi