arXiv Machine Learning By Zavier Li

Information-Induced Training Geometry: Exact Reduction, Canonical Completion, and Structured Expressivity

Read the original on arXiv Machine Learning →

The paper investigates how training data limits the geometry of an optimizer through the covectors that a specified information channel can observe. It establishes that, under affine‑invariant Riemannian geometry, a full‑column‑rank positive‑definite compression can be uniquely completed via a split‑Hadamard metric submetry, yielding exact variational reduction from the full geometry to the visible target. The resulting framework provides explicit formulas for pullback metrics, Gram matrices, and prior‑data shrinkage, and characterizes the gauge‑invariant rank stratification of the positive‑definite cone as the channel varies.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jul 9

Geometric--Nongeometric Optimizer Calculus: A Modular Language for Reachable Gradient Methods

arXiv:2607. 07206v1 Announce Type: new Abstract: Adaptive optimizers mix several mechanisms: a metric or preconditioner maps gradients to descent directions, while estimation, memory, step-size control, constraints, stochasticity, target modification, and discretization determine which directions are available and how they are used.

By Zavier Li