arXiv AI By Tianhui Liu, Lili Mou

Do Neural Networks Lose Plasticity in a Gradually Changing World?

Read the original on arXiv AI →

arXiv:2602. 09234v2 Announce Type: replace-cross Abstract: Continual learning has become a trending topic in machine learning.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

Hugging Face Trending Papers
Jun 23

Can Scale Save Us From Plasticity Loss in Large Language Models?

The loss of plasticity - the ability of a network to learn new information after having already learned older information - is a fundamental challenge in creating artificial neural networks capable of continual learning. Although this phenomenon has been known for decades, it has mostly been studied in older, relatively small architectures and rarely in natural-language domains.

arXiv AI
Jun 24

Can Scale Save Us From Plasticity Loss in Large Language Models?

arXiv:2606. 24752v1 Announce Type: new Abstract: The loss of plasticity - the ability of a network to learn new information after having already learned older information - is a fundamental challenge in creating artificial neural networks capable of continual learning.

By J. Fernando Hernandez-Garcia, Tom\'as Figliolia, Beren Millidge
arXiv AI
Aug 7

Continual Learning in Transition

arXiv:2608. 06216v1 Announce Type: cross Abstract: Classical continual learning (CL) has primarily focused on enabling models to update and retain knowledge through parameter-centric mechanisms, e.

By Zhiyan Hou, Dan Zhang, Tao Feng, Liyuan Wang, Wei Li, Xiangzhao Hao, Hongyan An, Junfeng Fang, Haokai Ma, Zhaohui Xu, Haiyun Guo, Jinqiao Wang, Tat-Seng Chua