arXiv Computation and Language October 28, 2026 By Hee Seung Hwang, Xindi Wu, Sanghyuk Chun, Olga Russakovsky, Zhiwei Deng

Reinforced Fast Weights via Next-Sequence Prediction

Read the original on arXiv Computation and Language →

The paper "Reinforced Fast Weights via Next-Sequence Prediction" introduces ReFINE, a method that extends the next-token prediction objective to next-sequence prediction for fast weight architectures. ReFINE selects informative token positions, generates multi-token rollouts, assigns sequence-level rewards, and optimizes the model using Group Relative Policy Optimization. Experiments on LaCT-760M and DeltaNet-1.3B demonstrate that ReFINE consistently outperforms standard next-token prediction fine‑tuning across retrieval, long‑context question answering, and LongBench tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language

Oct 15

Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules

arXiv:2610.19210v1 Announce Type: new Abstract: Transformers are efficient to pre-train at scale because attention permits parallel computation across sequence positions, but long-context inference r...

By Sarah Pan, Ali Behrouz

llms benchmarks

arXiv Machine Learning

Aug 4

Learning What to Remember: Test-Time Training via Context Distillation

arXiv:2608. 01672v1 Announce Type: cross Abstract: Effective long-context modeling is not merely about retaining more of the past, but about preserving the information that may prove relevant later.

By Zixuan Wang, Xingyu Dang, Rui-Jie Zhu, Zixin Wen, Hengyu Fu, Wenhao Chai, Jason D. Lee

llms efficiency

arXiv AI

Jul 9

Exploration of Fast-Slow Latent Recurrence for Train-Short, Test-Long Generalization

arXiv:2604. 01577v3 Announce Type: replace-cross Abstract: We study out of distribution generalization in streaming tasks where models are trained on short sequences but must operate over much longer, unknown horizons under bounded memory.

By Shota Takashiro, Masanori Koyama, Takeru Miyato, Yusuke Iwasawa, Yutaka Matsuo, Kohei Hayashi

llms reinforcement-learning safety

arXiv Machine Learning

Jun 29

Learning to Evict from Key-Value Cache

arXiv:2602. 10238v2 Announce Type: replace-cross Abstract: The growing size of Large Language Models (LLMs) makes efficient inference challenging, primarily due to the memory demands of the autoregressive Key-Value (KV) cache.

By Luca Moschella, Laura Manduchi, Ozan Sener

llms agents reinforcement-learning efficiency benchmarks

arXiv Machine Learning

Jun 5

Pretraining Recurrent Networks without Recurrence

arXiv:2606. 06479v1 Announce Type: new Abstract: Training recurrent neural networks (RNNs) requires assigning credit across long sequences of computations.

By Akarsh Kumar, Phillip Isola

llms

arXiv Machine Learning

Sep 2

Latent Recurrent Transformer: Architecture Exploration, Training Strategies, and Scaling Behavior

arXiv:2605.26797v2 Announce Type: replace Abstract: We study Latent Recurrent Transformer (LRT), a lightweight augmentation of autoregressive transformers that reuses a high-level source-layer hidden...

By Zeyi Huang, Xuehai He, LiLiang Ren, Yiping Wang, Baolin Peng, Hao Cheng, Shuohang Wang, Pengcheng He, Jianfeng Gao, Yong Jae Lee, Yelong Shen

llms

One email a morning, machine-written

Related stories

Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules

Learning What to Remember: Test-Time Training via Context Distillation

Exploration of Fast-Slow Latent Recurrence for Train-Short, Test-Long Generalization

Learning to Evict from Key-Value Cache

Pretraining Recurrent Networks without Recurrence

Latent Recurrent Transformer: Architecture Exploration, Training Strategies, and Scaling Behavior