arXiv:2608. 01130v1 Announce Type: new Abstract: A broad range of models face the mismatch where they are updated through trajectory losses but are evaluated by downstream task reward.
By Yuyang Shen
The paper introduces Fisher-Shaped EWC (FS‑EWC), a replay‑free continual learning method that extends Elastic Weight Consolidation by controlling Fisher sensitivity over a neighborhood of future updates. FS‑EWC minimizes the worst‑case empirical Fisher information trace during task learning, favoring solutions robust to bounded parameter displacement, and uses trajectory‑based model merging to construct the retained solution from multiple optimization states. Experiments on several benchmarks demonstrate that FS‑EWC outperforms standard EWC, achieving a better stability–plasticity balance and higher tolerance to parameter drift.
By Liying Wang, Simone Magistri, Joost van de Weijer
arXiv:2607. 21644v1 Announce Type: new Abstract: We present a goal-agnostic control framework for partial differential equations (PDEs) built around a joint-embedding predictive architecture (JEPA).
By Jonathan Gallagher, Roberto Guglielmi
The paper presents a nonlinear dissipative dynamical model of human learning, featuring a concept‑transfer matrix, per‑concept forgetting rates, and a saturating practice‑response gain. It proves a structural identifiability theorem that guarantees exact parameter recovery under explicit excitation conditions, provides closed‑form recovery for the two‑concept case, and introduces a fast, L‑stable numerical scheme enabling estimation on large learner cohorts. Empirical results show exact recovery on synthetic data with designed excitation, but failure to recover on large observational benchmarks, illustrating a sharp boundary between identifiable and unidentifiable regimes and offering a validation protocol for interpretability claims.
By Arman Kostanian, Armen Beklaryan
arXiv:2608.23889v1 Announce Type: cross
Abstract: Plasticity under changing environments is central to both evolutionary biology and continual learning. Motivated by recent work on genotype--phenotyp...
By Owen Skriloff
The paper introduces ReQRL, a method for learning quasimetric geometry in goal-conditioned reinforcement learning by constraining the critic’s value gradients with finite-horizon reachability. It decouples dynamical reachability from boundary geometry, estimating both from data using state-constrained optimal control principles. Experiments on OGBench show that ReQRL matches or surpasses existing quasimetric and offline GCRL approaches.
By Daisuke Yamada, Travis Pence, Vikas Singh
The paper introduces Fisher-Shaped EWC (FS‑EWC), a method that extends Elastic Weight Consolidation by controlling Fisher sensitivity over a neighborhood of potential future updates. FS‑EWC minimizes the worst‑case empirical Fisher information trace during task learning, favoring solutions less sensitive to bounded future displacement, and uses trajectory‑based model merging to construct the retained solution. Experiments on multiple benchmarks show that FS‑EWC outperforms standard EWC, achieving a better stability–plasticity balance and greater tolerance to parameter drift.
The paper investigates continuous‑time stochastic control problems with unknown drift and running reward functions, using an exploratory reinforcement learning framework that incorporates relaxed controls and entropy regularization. It develops policy‑iteration algorithms based on probabilistic representations of the optimal value function and its gradient, proving convergence and demonstrating performance through numerical examples. The study also extends to a special case with control‑dependent diffusion, requiring a Hessian representation.
By Jin Ma, Gaozhan Wang, Jianfeng Zhang, Xunyu Zhou
arXiv:2602. 10430v2 Announce Type: replace-cross Abstract: Off-policy policy optimization reuses historical behavior, including negative-advantage samples that suppress known failures.
By Yusen Huo, Changping Wang, Yangru Huang, Jun Zhang, Jie Jiang
The paper identifies an informational curse of horizon in goal-conditioned policy learning, showing that longer goal relabeling horizons during training can hurt policy generalization and performance. Controlled experiments with oracle planners separate training horizons from test horizons, revealing that behavioral cloning policies degrade with longer horizons while reinforcement learning mitigates this effect. The authors attribute this to reduced conditional mutual information between actions and hindsight-relabeled goals, and demonstrate that distilling short-horizon policy Jacobians into long-horizon policies improves performance, especially in combinatorial manipulation tasks.
By John L. Zhou, Yuxuan Dong, Jonathan C. Kao
arXiv:2608. 08158v1 Announce Type: new Abstract: Sparse, delayed, and weakly informative rewards remain central obstacles to efficient reinforcement learning.
By Fouad Bahrpeyma
arXiv:2608. 11690v1 Announce Type: new Abstract: Continual learning must absorb new tasks without erasing old ones, and replay---mixing a small buffer of past examples into current training---is among the most effective remedies for catastrophic forgetting.
By Tieliang Gong, Zhongbo Zhang, Wen Wen, Yong-Jin Liu