arXiv Machine Learning

Genetic algorithm vs. gradient descent for training a neural network architecture dedicated to low data regimes in small medical datasets

The paper compares genetic algorithm (GA) and gradient descent (GD) training for a distance‑encoding biomorphic‑informational neural network (DEBI‑NN) designed for low‑data medical datasets. A spatial backpropagation scheme was implemented for GD, and both optimizers were evaluated on synthetic, radiomic, and fetal cardiotocography datasets. Across all experiments, GA consistently outperformed GD, achieving higher classification accuracy and more stable decision boundaries, while GD struggled with the interdependent spatial parameters of DEBI‑NN.

arXiv Machine Learning
Sep 11

Breaking the Central Bias: Spatially Partitioned Experts for Coordinate-Based Neuroevolution

The paper investigates a spatial-concentration bias in Evolvable-Substrate HyperNEAT (ES‑HyperNEAT) when applied to MNIST, where evolved networks focus on a central cluster of input pixels. By partitioning the input image into 13 non‑overlapping spatial segments and evolving a separate expert network for each, the authors achieve a 43% mean accuracy—an 106% relative improvement over the baseline—without relying on data‑driven weighting. The study also introduces a receptive‑field diagnostic to detect silent input‑coverage collapse and a spatial‑partitioning remedy to restore full image coverage.

By Romain Claret, Arthur Gygax, Michael O'Neill, Paul Cotofrei, Michael Palma Mendes, Pascal Felber
arXiv Machine Learning
Aug 3

MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification

arXiv:2607. 29462v1 Announce Type: cross Abstract: Adapting deep learning models to profound clinical heterogeneity typically relies on parameter-efficient fine-tuning (PEFT) to avoid the severe overfitting associated with full end-to-end network updates.

By Sebastian Doerrich, Daniel W\"urtinger, Francesco Di Salvo, Shyam Nandan Rai, Christian Ledig