Hugging Face Trending Papers June 23, 2026

ReM-MoA: Reasoning Memory Sustains Mixture-of-Agents Scaling

Read the original on Hugging Face Trending Papers →

Mixture-of-Agents (MoA) architectures improve inference-time scaling by organizing multiple LLM agents into layered reasoning pipelines. However, existing MoA variants fail to sustain gains as depth increases, exhibiting degradation, early plateauing, or saturation.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv AI

Jun 24

ReM-MoA: Reasoning Memory Sustains Mixture-of-Agents Scaling

arXiv:2606. 24437v1 Announce Type: new Abstract: Mixture-of-Agents (MoA) architectures improve inference-time scaling by organizing multiple LLM agents into layered reasoning pipelines.

By Heng Ping, Arijit Bhattacharjee, Peiyu Zhang, Shixuan Li, Wei Yang, Ali Jannesari, Nesreen Ahmed, Paul Bogdan

llms agents efficiency benchmarks

arXiv Machine Learning

Jun 17

Continual Self-Improvement with Lightweight Experiential Latent Memories

arXiv:2606. 17803v1 Announce Type: new Abstract: Large language models achieve strong reasoning performance by scaling inference-time compute, yet remain fundamentally stateless, discarding the rich, self-produced reasoning traces generated during this process.

By Vaggelis Dorovatas, Nancy Kalaj, Rahaf Aljundi

llms reinforcement-learning benchmarks

arXiv AI

Jul 13

HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs

arXiv:2604. 20140v2 Announce Type: replace Abstract: Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks.

By Darsh Kachroo, Arjun Prasaath Anbazhagan, Adriana Caraeni, Brennan Lagasse, Kevin Zhu

llms agents reinforcement-learning fine-tuning benchmarks

arXiv AI

Jul 28

SF-AMS: Strategic Forgetting for Structured Memory in LLM Agent

arXiv:2607. 22562v1 Announce Type: new Abstract: Managing long-context dependencies remains a primary bottleneck in LLM agents, as redundant and irrelevant information can degrade multi-step reasoning.

By Ning Yang, Siqi Li, Miaoxin Shen, Yuan Zhou, Meng Zhang, Tong Li, Haijun Zhang

llms agents

arXiv AI

Jun 6

Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agents

arXiv:2606. 06036v1 Announce Type: new Abstract: Despite recent progress, LLM agents still struggle with reasoning over long interaction histories.

By Shuo Ji, Yibo Li, Bryan Hooi

llms agents benchmarks

arXiv AI

Jun 9

Generative Reasoning Re-ranker

arXiv:2602. 07774v5 Announce Type: replace-cross Abstract: Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge.

By Mingfu Liang, Yufei Li, Jay Xu, Kavosh Asadi, Xi Liu, Shuo Gu, Kaushik Rangadurai, Frank Shyu, Shuaiwen Wang, Song Yang, Zhijing Li, Jiang Liu, Mengying Sun, Fei Tian, Xiaohan Wei, Chonglin Sun, Jacob Tao, Shike Mei, Wenlin Chen, Santanu Kolay, Sandeep Pandey, Hamed Firooz, Luke Simon

llms rag nlp reinforcement-learning fine-tuning benchmarks

Related stories

ReM-MoA: Reasoning Memory Sustains Mixture-of-Agents Scaling

Continual Self-Improvement with Lightweight Experiential Latent Memories

HiPO: Hierarchical Preference Optimization for Adaptive Reasoning in LLMs

SF-AMS: Strategic Forgetting for Structured Memory in LLM Agent

Memory is Reconstructed, Not Retrieved: Graph Memory for LLM Agents

Generative Reasoning Re-ranker