arXiv Machine Learning By Pranavanath Balamurali, Hrishi Kamireddy

TinyUDE: Solver-Free Universal Differential Equations on Microcontrollers via Lie-Taylor Jet Matching

Read the original on arXiv Machine Learning →

TinyUDE introduces a solver‑free training framework for Universal Differential Equations (UDEs) that fits a hybrid vector field directly to the first and second time‑derivatives of observed system states using Lie‑Taylor jet matching. The method estimates these derivatives online via Savitzky‑Golay filtering, enabling fully analytic gradients without automatic differentiation. Experiments on damped and chaotic pendulum systems show that TinyUDE matches or surpasses conventional solver‑based baselines while using less than 108 kB of static memory and achieving real‑time on‑device training on an ESP32 microcontroller.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 4

AOS: Adaptive Optimizer Switching via Training-State Signals for Faster Convergence and Better Generalization

arXiv:2608. 01997v1 Announce Type: new Abstract: Single-optimizer training is a poor fit for the distinct phases of deep network optimization: adaptive methods handle noisy early gradients well but overshoot flat minima, while SGD with momentum generalizes better in the late phase but converges slowly early on.

By Alok Kumar Pandey, Umang Chaturvedi, Aatish Rana, Gopi Krishna Nedanuri