arXiv Machine Learning By Zavier Li

Restricted Dynamic Geometric Complexity: Certificates for Structured Preconditioning

Read the original on arXiv Machine Learning →

arXiv:2607. 07204v1 Announce Type: cross Abstract: Optimization geometrodynamics views optimizer state as evolving geometry.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jul 9

Geometric--Nongeometric Optimizer Calculus: A Modular Language for Reachable Gradient Methods

arXiv:2607. 07206v1 Announce Type: new Abstract: Adaptive optimizers mix several mechanisms: a metric or preconditioner maps gradients to descent directions, while estimation, memory, step-size control, constraints, stochasticity, target modification, and discretization determine which directions are available and how they are used.

By Zavier Li