arXiv AI June 12, 2026 By Lorenzo Braccaioli, Anna Vettoruzzo, Prabhant Singh, Joaquin Vanschoren, Mohamed-Rafik Bouguelia, Nicola Conci

Meta-Learning Transformers to Improve In-Context Generalization

Read the original on arXiv AI →

arXiv:2507. 05019v2 Announce Type: replace-cross Abstract: In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

arXiv Machine Learning

Jul 7

Labeled-Data-Free Meta-Learning: Efficient Task Generation Using Pre-trained Models and Unlabeled Data

arXiv:2607. 02850v1 Announce Type: new Abstract: Meta-learning without labeled data is crucial for real-world applications, where obtaining labeled datasets can be expensive or restricted due to privacy concerns.

By Lei Sun, Yusuke Tanaka, Tomoharu Iwata

benchmarks safety

arXiv AI

Jul 8

Universal Algorithm-Implicit Learning

arXiv:2602. 14761v2 Announce Type: replace-cross Abstract: Current meta-learning methods are constrained to narrow task distributions with fixed feature and label spaces, limiting applicability.

By Stefano Woerner, Seong Joon Oh, Christian F. Baumgartner

llms rag nlp multimodal benchmarks

arXiv AI

6d ago

Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge

arXiv:2608. 12218v1 Announce Type: cross Abstract: Large language models are increasingly trained and deployed with long contexts that span documents, code repositories, and interaction histories.

By Arda Uzunoglu, Benjamin van Durme, Daniel Khashabi

llms fine-tuning

arXiv Machine Learning

Jul 1

Probing Memorization of Tabular In-Context Learning

arXiv:2606. 31208v1 Announce Type: new Abstract: Large tabular models (LTMs), i.

By Francesco Capano, Jonas B\"ohler

llms fine-tuning benchmarks

arXiv Machine Learning

Jul 13

Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem

arXiv:2607. 09236v1 Announce Type: new Abstract: Machine unlearning in LLMs is the targeted removal of specific knowledge while preserving all other capabilities, critical for privacy and safety.

By Amit Peleg, Naman Deep Singh, Naama Pearl, Bibhabasu Mohapatra, Matthias Hein

llms benchmarks safety

arXiv Machine Learning

Aug 4

Learning What to Remember: Test-Time Training via Context Distillation

arXiv:2608. 01672v1 Announce Type: cross Abstract: Effective long-context modeling is not merely about retaining more of the past, but about preserving the information that may prove relevant later.

By Zixuan Wang, Xingyu Dang, Rui-Jie Zhu, Zixin Wen, Hengyu Fu, Wenhao Chai, Jason D. Lee

llms efficiency

Related stories

Labeled-Data-Free Meta-Learning: Efficient Task Generation Using Pre-trained Models and Unlabeled Data

Universal Algorithm-Implicit Learning

Information Abundance Paradox: Long-Context Training Undermines Parametric Knowledge

Probing Memorization of Tabular In-Context Learning

Forget Narrowly, Retain Broadly: Unlearning as an Asymmetric Generalization Problem

Learning What to Remember: Test-Time Training via Context Distillation