arXiv AI June 2, 2026 By Hao Xu, Rite Bo, Fausto Giunchiglia, Yingji Li, Rui Song

Toward Robust In-Context Learning: Leveraging Out-of-distribution Proxies for Target Inaccessible Demonstration Retrieval

arXiv:2606. 00014v1 Announce Type: cross Abstract: Although studies have demonstrated that Large Language Models (LLMs) can perform well on Out-of-Distribution (OOD) tasks, their advantage tends to diminish as the distribution shift becomes more severe.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.

llms

arXiv AI

Jun 30

LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction

arXiv:2606. 29407v1 Announce Type: cross Abstract: There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation extraction (RE).

By Xiao You, Tianwei Yan, Shan Zhao

llms nlp

arXiv AI

Jun 9

Language-based Trial and Error Falls Behind in the Era of Experience

arXiv:2601. 21754v3 Announce Type: replace Abstract: While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.

By Haoyu Wang, Guozheng Ma, Shugang Cui, Yilun Kong, Haotian Luo, Li Shen, Mengya Gao, Yichao Wu, Xiaogang Wang, Dacheng Tao

llms agents reinforcement-learning fine-tuning

arXiv AI

Jul 7

Context Tuning for In-Context Optimization

arXiv:2507. 04221v3 Announce Type: replace-cross Abstract: We introduce Context Tuning, a simple and effective method to significantly enhance few-shot adaptation of large language models (LLMs) without weight updates.

By Jack Lu, Ryan Teehan, Zhenbang Yang, Mengye Ren

llms benchmarks

arXiv Machine Learning

Jun 4

Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning

arXiv:2606. 04434v1 Announce Type: cross Abstract: Multimodal In-Context Learning (ICL) has emerged as a practical inference paradigm for Multimodal Large Language Models, where a small set of interleaved image-text In-Context Demonstrations (ICDs) conditions the model to solve new tasks.

By Niloufar Alipour Talemi, Hossein Kashiani, Fatemeh Afghah

llms efficiency multimodal benchmarks

arXiv Machine Learning

5d ago

MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning

arXiv:2608. 12724v1 Announce Type: new Abstract: Few-shot in-context learning (ICL) with multi-modal large language models (MLLMs) enables task adaptation without parameter updates, but its performance is highly sensitive to the quality and coverage of the selected demonstrations.

By Zirui Cheng, Xun Xu, Tiankai Chen, Fady Rezk, Bowen Zheng, Xiaodong Shi, Shijie Li, Kangkang Lu, Bharadwaj Veeravalli, Nancy F. Chen

llms multimodal benchmarks

Hugging Face Trending Papers

Aug 5

EdgeLM: Edge Demonstrations for Language Models' Table Understanding

Large language models (LLMs) perform table-centric prediction through in-context learning, making demonstration selection critical to performance. Existing retrieval methods prioritize similarity to the query, but similar demonstrations often reinforce the model's likely prediction rather than reveal the distinctions needed for difficult decisions.

llms

Related stories

LC-ICL: Label-Guided Contrastive In-Context Learning for Robust Information Extraction

Language-based Trial and Error Falls Behind in the Era of Experience

Context Tuning for In-Context Optimization

Hyper-ICL: Attention Calibration with Hyperbolic Anchor Distillation for Multimodal In-Context Learning

MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning

EdgeLM: Edge Demonstrations for Language Models' Table Understanding