Measuring Structured Predictability in Neural Training Dynamics: A Cross-Regime Study
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2608. 15483v1 Announce Type: new Abstract: Modern deep networks are trained through long update trajectories, yet their temporal organization remains less systematically characterized than architectures, losses, or optimizers.
arXiv:2610.20439v1 Announce Type: new Abstract: We study classification dynamics under small initialization and identify a pronounced non-monotone behavior of accuracy that we call the accuracy well:...
arXiv:2604. 00230v2 Announce Type: replace Abstract: Neural collapse (NC) -- the convergence of penultimate-layer features to a simplex equiangular tight frame -- is well understood at equilibrium, but the dynamics governing its onset remain poorly characterised.
arXiv:2608. 12939v1 Announce Type: new Abstract: Joint-embedding predictive architectures (JEPAs) learn world models that predict in a compact latent space rather than in pixels, reducing the pressure to model nuisance appearance.
arXiv:2608.30946v1 Announce Type: new Abstract: Closed-loop human-AI systems generate high-dimensional behavioural trajectories whose collective dynamics remain obscure. Using 297,915 learners' adapt...
The study evaluates self‑supervised pretraining for Prognostics and Health Management (PHM) across 47 public datasets, using a compact Transformer encoder trained with masked patch prediction. Transfer performance is highly task‑dependent: it dramatically improves fault‑classification on CWRU and HSG18 but offers no reliable benefit for remaining‑useful‑life estimation on CMAPSS. The authors also compare centralized versus simulated federated pretraining, finding that centralized training generally outperforms federated training under matched budgets, and that the intrinsic SSL loss does not reliably predict downstream performance.