arXiv AI

Adaptive Hybrid Particle Swarm Optimization with Gradient Descent

arXiv:2608. 11258v1 Announce Type: new Abstract: Gradient injection helps Particle Swarm Optimization (PSO) only when the swarm has identified a basin with smooth local structure, not universally.

arXiv AI
Sep 2

Flawed in Nature, Perfect through Evolution

arXiv:2609.00129v1 Announce Type: cross Abstract: The performance of artificial intelligence (AI) and machine learning (ML) models degrades when the problem they were trained on drifts. This is a nea...

By J. M. Diederik Kruijssen (Allora Foundation)
arXiv Machine Learning
Jun 8

LAGO: A Local-Global Optimization Framework Combining Trust Region Methods and Bayesian Optimization

arXiv:2603. 02970v2 Announce Type: replace Abstract: We introduce LAGO, a LocAl-Global Optimization framework coupling Bayesian Optimization (BO) and gradient-based trust region local refinement through an adaptive competition mechanism for smooth expensive-to-evaluate objective functions with available gradients.

By Eliott Van Dieren, Tommaso Vanzan, Fabio Nobile
arXiv Machine Learning
Aug 11

Directional-Clamp PPO

arXiv:2511. 02577v2 Announce Type: replace Abstract: Proximal Policy Optimization (PPO) is widely regarded as one of the most successful deep reinforcement learning algorithms, known for its robustness and effectiveness across a range of problems.

By Gilad Karpel, Ruida Zhou, Shoham Sabach, Mohammad Ghavamzadeh
arXiv Machine Learning
Sep 3

Explainable Information Processing in Particle Swarm Optimization through Landscape and Search Behavior Analysis

The paper introduces a dual‑perspective explainability framework for Particle Swarm Optimization (PSO). From a landscape viewpoint, it uses Exploratory Landscape Analysis (ELA) and machine‑learning classifiers to predict topology‑specific hyperparameters for unseen problems. From an algorithmic viewpoint, it incorporates IOHxplainer and Search Trajectory Networks (STN) with new metrics—Connectivity Density, Fragmentation Score, and Search Efficiency—to visualize and quantify PSO’s search organization and transition effectiveness across 24 benchmark functions and multiple topologies.

By Nitin Gupta, Bapi Dutta, Anupam Yadav
arXiv Machine Learning
Aug 4

AOS: Adaptive Optimizer Switching via Training-State Signals for Faster Convergence and Better Generalization

arXiv:2608. 01997v1 Announce Type: new Abstract: Single-optimizer training is a poor fit for the distinct phases of deep network optimization: adaptive methods handle noisy early gradients well but overshoot flat minima, while SGD with momentum generalizes better in the late phase but converges slowly early on.

By Alok Kumar Pandey, Umang Chaturvedi, Aatish Rana, Gopi Krishna Nedanuri