arXiv Machine Learning

Dynamic Symmetric Point Tracking: Tackling Non-ideal Reference in Analog In-memory Training

arXiv:2602. 21321v2 Announce Type: replace Abstract: Analog in-memory computing (AIMC) performs computation directly within resistive crossbar arrays, offering an energy-efficient platform to scale large vision and language models.

arXiv Machine Learning
Sep 24

TinyUDE: Solver-Free Universal Differential Equations on Microcontrollers via Lie-Taylor Jet Matching

TinyUDE introduces a solver‑free training framework for Universal Differential Equations (UDEs) that fits a hybrid vector field directly to the first and second time‑derivatives of observed system states using Lie‑Taylor jet matching. The method estimates these derivatives online via Savitzky‑Golay filtering, enabling fully analytic gradients without automatic differentiation. Experiments on damped and chaotic pendulum systems show that TinyUDE matches or surpasses conventional solver‑based baselines while using less than 108 kB of static memory and achieving real‑time on‑device training on an ESP32 microcontroller.

By Pranavanath Balamurali, Hrishi Kamireddy
arXiv Machine Learning
Jul 14

Machine Learning-Based Reconstruction for Resistive Silicon Sensors

arXiv:2607. 11585v1 Announce Type: cross Abstract: Low-Gain Avalanche Diodes (LGADs) and AC-coupled Low-Gain Avalanche Diodes (AC-LGADs) are promising technologies for precision timing and four-dimensional tracking.

By Alexander Aoki, Gaetano Barone, Leena Diehl, Gabriele Giacomini, Vagelis Gkougkousis, Hanshal Goyal, Rohan Kher, Daniel Li, Anna Macchiolo, Yevhenii Padnuik, Daria Senina, Samantha Sunnarborg, Jessica Tang, Alessandro Tricoli, Lixing Wang, Don C. Wong
arXiv AI
Oct 1

dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale

The paper introduces dattri-LLM, a library designed to make training data attribution (TDA) practical for large language models. It achieves efficiency by using compact gradient representations and a cost‑based routing system, while maintaining compatibility by capturing per‑example gradients from existing training loops without modifications, even in distributed settings. The library also offers extensibility through reusable gradient operations and callbacks, supporting various attribution methods and applications such as online data selection, and demonstrates significant performance gains and scalability up to 110B‑parameter models.

By Shixuan Liu, Tongli Zhou, Junwei Deng, Pingbang Hu, Jiaqi W. Ma