arXiv AI By Tsz Ting Chung, Lemao Liu, Mo Yu, Dit-Yan Yeung

Many-Shot CoT-ICL: Making In-Context Learning Truly Learn

Read the original on arXiv AI →

arXiv:2605. 13511v3 Announce Type: replace-cross Abstract: While many-shot ICL achieves remarkable performance, prior studies of its scaling behavior have mainly focused on non-reasoning tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 3

SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning

The paper introduces SALA, a Semantic‑Aware Logical Alignment framework designed to improve demonstration selection for complex reasoning in in‑context learning. SALA learns task‑specific reasoning operations, embeds them into a continuous semantic space, and applies dynamic time warping to flexibly align reasoning sequences, offering soft matching and interpretability. Experiments on four reasoning benchmarks with three large language models show that SALA outperforms existing methods, and analysis highlights the importance of operation induction and logical semantic alignment.

By Zhao Ji, Wenqing Chen, Zhixuan Chu, Jianxing Yu, Jingping Liu, Shanhe Zhao, Zibin Zheng
arXiv AI
3d ago

Hermes: Learning Contextual Reasoning Unlocks Test-Time Scaling

Hermes introduces a family of harnesses that give models control over how they allocate and reuse context windows during inference, a capability termed contextual reasoning. The accompanying Hermes‑Learn framework trains models in two stages to develop these decision‑making skills, enabling them to scale performance with additional compute at test time. Experiments show that while large models naturally benefit, smaller open‑source models can close the performance gap through this training, with gains generalizing across benchmarks, extrapolating beyond trained compute, and transferring to other scaling methods.

By Xinyu Li, Mononito Goswami, Hao Liu, Nikos Kanakaris, Langlin Huang, Prithwish Jana, Patrick Bl\"obaum, Purak Jain