arXiv:2609.36584v1 Announce Type: new
Abstract: Analog in-memory computing (AIMC) offers an alternative for model training by executing matrix operations directly where weights are stored. However, s...
By Zhaoxian Wu, Tayfun Gokmen, Omobayode Fagbohungbe, T. Patrick Xiao, Tianyi Chen
arXiv:2607. 28418v1 Announce Type: cross Abstract: Pruning is a promising approach for improving the efficiency of LLMs.
By Haozhe Hu, Hao Wu, Peiran Yin, Chao Han, Yunpu Ma, Xiaoyu Shen
TinyUDE introduces a solver‑free training framework for Universal Differential Equations (UDEs) that fits a hybrid vector field directly to the first and second time‑derivatives of observed system states using Lie‑Taylor jet matching. The method estimates these derivatives online via Savitzky‑Golay filtering, enabling fully analytic gradients without automatic differentiation. Experiments on damped and chaotic pendulum systems show that TinyUDE matches or surpasses conventional solver‑based baselines while using less than 108 kB of static memory and achieving real‑time on‑device training on an ESP32 microcontroller.
By Pranavanath Balamurali, Hrishi Kamireddy
arXiv:2607. 18306v1 Announce Type: cross Abstract: Sharpness-Aware Minimization (SAM) improves generalization by minimizing the worst-case loss in a local parameter neighborhood.
By Zhen Huang, Jiaxin Deng, Junbiao Pang
arXiv:2606. 15004v1 Announce Type: cross Abstract: Deploying neural networks on low-power microcontrollers (MCUs) requires selecting model architectures under tight memory, latency, and energy constraints.
By Joseph Q. Zales, Pragya Sharma, Mani Srivastava
arXiv:2606. 17249v1 Announce Type: cross Abstract: The dominant trajectory of modern machine learning has been to scale up: larger models, larger accelerators, larger memory budgets.
By Emre Can Kizilates
arXiv:2607. 11585v1 Announce Type: cross Abstract: Low-Gain Avalanche Diodes (LGADs) and AC-coupled Low-Gain Avalanche Diodes (AC-LGADs) are promising technologies for precision timing and four-dimensional tracking.
By Alexander Aoki, Gaetano Barone, Leena Diehl, Gabriele Giacomini, Vagelis Gkougkousis, Hanshal Goyal, Rohan Kher, Daniel Li, Anna Macchiolo, Yevhenii Padnuik, Daria Senina, Samantha Sunnarborg, Jessica Tang, Alessandro Tricoli, Lixing Wang, Don C. Wong
arXiv:2608. 02700v1 Announce Type: cross Abstract: Analog compute-in-memory (CIM) enables energy-efficient neural network inference, but device variation and read noise can severely degrade low-bit quantized models.
By Yizhe Chen, Wenshuai Yao, Saiya Wang, Yuannuo Feng, Wenbo Qi, Kechao Tang, Ngai Wong, Wenyong Zhou, Wang Kang
arXiv:2606. 26795v1 Announce Type: cross Abstract: Video Diffusion Models (VDMs) is constrained by immense computational costs.
By Zheqi Lv, Zhibo Zhu, Jinke Wang, Qi Tian, Shengyu Zhang, Zhengyu Chen, Chengxi Zang, Zhou Zhao, Fei Wu
The paper introduces dattri-LLM, a library designed to make training data attribution (TDA) practical for large language models. It achieves efficiency by using compact gradient representations and a cost‑based routing system, while maintaining compatibility by capturing per‑example gradients from existing training loops without modifications, even in distributed settings. The library also offers extensibility through reusable gradient operations and callbacks, supporting various attribution methods and applications such as online data selection, and demonstrates significant performance gains and scalability up to 110B‑parameter models.
By Shixuan Liu, Tongli Zhou, Junwei Deng, Pingbang Hu, Jiaqi W. Ma
arXiv:2607. 03349v1 Announce Type: cross Abstract: The accuracy of consumer-grade inertial navigation is bottlenecked by the stochastic noise of Micro-Electro-Mechanical Systems (MEMS).
By I-Hao Lu, Dongsoo Han
arXiv:2607. 21999v1 Announce Type: new Abstract: Long-tailed learning couples two sources of poor generalization: head classes dominate training exposure, while under-represented classes often converge to sharper regions of the loss landscape.
By Jiaxin Deng, Junbiao Pang