arXiv Machine Learning
Error Correction in Trained TTT Layers
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jul 14
Memory Savings at What Cost? A Study of Alternatives to Backpropagation
arXiv:2506. 21833v2 Announce Type: replace Abstract: Forward-mode automatic differentiation (FmAD) and zero-order (ZO) optimization are increasingly proposed as memory-efficient, backpropagation-free alternatives for large language model (LLM) fine-tuning, yet their benefits are typically evaluated only against standard backpropagation (BP), omitting memory-efficient variants such as activation checkpointing.
arXiv Machine Learning
Aug 10
Modular TTT: Rethinking Test-Time Training as Composable Modules
arXiv:2608. 07110v1 Announce Type: new Abstract: Test-time training (TTT) views sequence modeling as an online learning problem in which fast weights are updated by an internal learning rule.
arXiv Machine Learning
Sep 23
Terminal Shrinkage Averaging Reveals a Schedule-Estimator Interaction in LLM Pretraining
arXiv:2609.25482v1 Announce Type: new Abstract: Large language model (LLM) pretraining conventionally returns the raw final iterate. This couples two design choices: the learning-rate schedule that g...
arXiv Machine Learning
Aug 26
Delayed Optimizer-State Transport Shapes Short-Horizon Training Decisions
arXiv:2608.24593v1 Announce Type: new Abstract: Adaptive optimizers retain gradient history in moment variables, allowing a local change in loss weighting to alter later updates. We examine whether t...
arXiv Machine Learning
Jul 2
LeNEPA: No-Augmentation Next-Latent Prediction for Time-Series Representation Learning
arXiv:2607. 00958v1 Announce Type: new Abstract: Time series are central to modern data mining applications, from industrial telemetry and server metrics to finance and physiology, yet time-series self-supervised learning often depends on view and augmentation choices that encode domain-specific invariances.
arXiv Machine Learning
Sep 16
Test-Time Unlearning via Sparse Autoencoder
arXiv:2609.16229v1 Announce Type: new Abstract: Machine unlearning aims to remove specific knowledge from a trained large language model (LLM) without retraining from scratch. Existing methods modify...