Mistral AI

Un Ministral, des Ministraux

arXiv Machine Learning
3d ago

Least-time Gradient Flow

arXiv:2610. 01426v1 Announce Type: new Abstract: Prescribing the speed of gradient flow on the risk itself, by the dynamics $\dot w=-u(E(w))\nabla E(w)/\abs{\nabla E(w)}^{2}$, makes the risk $e(t)=E(w(t))$ obey $\dot e=-u(e)$ exactly, whatever the landscape~$E$; the time needed to reach zero risk from $e_0$ is $\int_0^{e_0}\dd e/u(e)$.

By Alessandro Betti, Marco Gori, Stefano Melacci, Jinwei Zhao