arXiv:2608. 14472v1 Announce Type: cross Abstract: Neural Architecture Search (NAS) aims to automate neural network architecture design, reducing reliance on human expertise.
By Abhishek Shukla, Ankur Sinha, Faiz Hamid
ONNX-Net introduces a universal representation for neural architectures using natural language descriptions, enabling instant performance prediction across diverse search spaces. The authors present ONNX-Bench, a benchmark of over 600k architecture–accuracy pairs compiled from open‑source NAS‑bench networks in ONNX format. Experiments demonstrate strong zero‑shot predictive performance with minimal pretraining, overcoming the limitations of cell‑based, graph‑encoded approaches.
By Shiwen Qin, Alexander Auras, Shay B. Cohen, Elliot J. Crowley, Michael Moeller, Linus Ericsson, Jovita Lukasik
arXiv:2608. 14443v1 Announce Type: cross Abstract: Neural Architecture Search (NAS) is naturally formulated as a bilevel optimization problem, where the upper-level optimizes the architecture using validation performance and the lower-level trains network parameters using training loss.
By Abhishek Shukla, Ankur Sinha, Faiz Hamid
DIFFNAS is a new neural architecture search framework that eliminates the need for performance predictors by using a discrete graph diffusion model conditioned on zero‑cost performance proxies such as MeCo and SWAP. The method achieves state‑of‑the‑art results on NAS‑Bench‑201 for CIFAR‑10 and CIFAR‑100, matching optimal architectures while cutting search cost by up to 17.5× compared to DiffusionNAG. Although its accuracy on the MobileNetV3 search space is lower than DiffusionNAG, the results demonstrate the potential of diffusion models combined with training‑free metrics for scalable architecture search.
By Yize Sun, Hanzhang Ma, Zixin Wu, Xuechun Li, Volker Tresp, Yunpu Ma
arXiv:2607. 11826v1 Announce Type: cross Abstract: Neural Architecture Search (NAS) has automated the design of deep learning models but traditionally requires massive computational resources, often measured in thousands of GPU-days.
By Romain Amigon
The paper introduces a semi-automated method for structuring neural architecture search (NAS) using large language models (LLMs). It defines a high-level template of architectural attributes, which an LLM populates by analyzing research papers to create a diverse search space. The authors then propose FairNAD, a multi-type mutation strategy that combines fair idea sampling, Pareto-aware mutation, LLM-driven iterative mutation, and a fine-grained feedback loop to efficiently explore this space, achieving significant performance gains on CIFAR-10, CIFAR-100, and ImageNet16-120.
By Yuiko Sakuma, Masakazu Yoshimura, Marcel Gr\"opl, Zitang Sun, Junji Otsuka, Atsushi Irie, Takeshi Ohashi