arXiv AI

Finding Kissing Numbers with Game-theoretic Reinforcement Learning

arXiv:2511. 13391v4 Announce Type: replace-cross Abstract: Since Isaac Newton first studied the Kissing Number Problem in 1694, determining the maximal number of non-overlapping spheres around a central sphere has remained a defining challenge in discrete geometry.

Hugging Face Trending Papers
Jun 24

Geometry-Aware MCTS for Extremal Problems in Combinatorial Geometry

We study certain extremal problems in combinatorial geometry that ask about configurations of points in an $n \times n$ grid that satisfy strict, global geometric constraints. Classical exact solvers suffer from combinatorial explosion for these types of problems, and standard reinforcement learning and transformer-based models struggle with the sparse reward "validity cliff" and quadratic token-consumption limits.

arXiv Machine Learning
Jun 9

Latent Spherical Flow Policy for Reinforcement Learning with Combinatorial Actions

arXiv:2601. 22211v2 Announce Type: replace Abstract: Reinforcement learning (RL) with combinatorial action spaces remains challenging because feasible action sets are exponentially large and governed by complex feasibility constraints, making direct policy parameterization impractical.

By Lingkai Kong, Anagha Satish, Hezi Jiang, Akseli Kangaslahti, Andrew Ma, Wenbo Chen, Mingxiao Song, Lily Xu, Milind Tambe
Hugging Face Trending Papers
Sep 17

Stable Movement for Nondual Lipschitz Convex Optimization: Efficiency and Nearly Optimal Oracle Rates

We study efficient algorithms for realizing the first-order oracle complexity of optimization of $G$-Lipschitz convex functions with respect to the $\ell_{q}$-norm over an $\ell_{p}$-ball of radius $R$, where $1\leq p,q\leq \infty$. For $p<q$, we obtain error $\widetilde{O}_{p,q}(GR/T^{1/p-(1/q-1/2)_{+}})$ after $T$ oracle queries, efficiently realizing the nearly optimal rates of (MBG+26), thereby resolving the nonsmooth end of the COLT 2015 open problem (Guz15b).

arXiv Machine Learning
Sep 25

RLVR landscapes for iterated multiplications can be benign: Insights from spin-glass theory

The paper investigates the optimization landscape of reinforcement learning with verifiable rewards (RLVR) on algorithmic tasks such as iterated group and quasigroup multiplication. By mapping entropy‑regularized RLVR with myopic tabular policies to a spin‑glass energy model, the authors prove that for a broad class of models with uncorrelated inputs the landscape is benign—there are no local minima that can trap training. They identify practical obstacles like diffusive barriers and gradient‑estimation errors, show these can be mitigated by choosing an appropriate entropy regulator, and demonstrate that a transformer trained from scratch with only last‑token rewards can learn an algorithmic chain of thought for iterated non‑Abelian group multiplications.

By Noa Rubin, Zohar Ringel
arXiv Machine Learning
Sep 3

Towards Solving the Gilbert-Pollak Conjecture via Large Language Models

The paper announces a new lower bound of 0.8559 for the Steiner ratio, improving on the previous 0.824 bound for the Gilbert‑Pollak Conjecture. It introduces an AI system that uses large language models to generate rule‑constrained geometric lemmas, which are then turned into executable verification functions that certify the bound. The approach relies on only thousands of LLM calls, highlighting the feasibility of LLM‑based methods for advanced mathematical research.

By Yisi Ke, Tianyu Huang, Yankai Shu, Di He, Jingchu Gai, Liwei Wang