arXiv Machine Learning

On the Slow Convergence to Trivial Solutions of Algorithms for Hard Optimization Problems

The paper investigates how optimization algorithms for hard combinatorial problems converge to trivial solutions. By combining rigorous large‑graph asymptotics with numerical experiments on maximum independent set and maximum K‑SAT, the authors show that convergence to the theoretically predicted bounds is extremely slow, especially in the intermediate regime of high constraint density. This reveals a significant gap between finite‑size performance and asymptotic expectations, indicating that practical algorithm design remains essential even when theory predicts inevitable failure.

Hugging Face Trending Papers
Aug 19

On the Slow Convergence to Trivial Solutions of Algorithms for Hard Optimization Problems

The paper investigates how algorithms for hard combinatorial optimization problems converge to trivial solutions, focusing on finite-size behavior rather than asymptotic limits. By analyzing large-graph asymptotics and running numerical experiments on problems like maximum independent set and maximum K‑SAT, the authors show that convergence to theoretically predicted bounds is surprisingly slow. In the intermediate regime of high constraint density, local algorithms actually outperform their asymptotic predictions, highlighting a gap between finite-regime performance and asymptotic theory.

arXiv AI
Sep 23

Smoothed Analysis of Inconsistent A*

arXiv:2609.23680v1 Announce Type: cross Abstract: The A* search is a fundamental path-finding algorithm in artificial intelligence. While admissible and consistent heuristics guarantee efficient perf...

By Zhiyang Chen, Hailong Yao
arXiv AI
Sep 17

Universal NP-Hardness of Clustering under General Utilities

The paper introduces the Universal Clustering Problem (UCP), a framework that captures the optimisation core common to many clustering methods by maximizing a polynomial‑time computable partition utility over a finite metric space. It proves UCP is NP‑hard through reductions from graph colouring and exact cover by 3‑sets, showing that popular algorithms such as k‑means, GMMs, DBSCAN, spectral clustering, and affinity propagation inherit this intractability. The authors argue that this unified hardness explains typical failure modes—like local optima and greedy merge traps—and suggest moving toward stability‑aware objectives and interaction‑driven formulations with explicit guarantees.

By Angshul Majumdar
arXiv AI
Sep 10

Optimal Experiments for Partial Causal Effect Identification

The paper tackles selecting a cost‑constrained set of experiments that most effectively tighten bounds on a partially identifiable causal query. It formalizes this as the NP‑hard max‑potency problem, introduces efficient graphical pruning rules to reduce the search space, and demonstrates the approach on synthetic graphs and real NHANES data to estimate the effect of physical activity on diabetes.

By Tobias Maringgele, Jalal Etesami