arXiv Machine Learning June 2, 2026 By Hyesung Jeon, Hyeongju Ha, Jae-Joon Kim

LRAgent: Efficient KV Cache Sharing for Multi-LoRA LLM Agents

Read the original on arXiv Machine Learning →

arXiv:2602. 01053v2 Announce Type: replace Abstract: Role specialization in multi-LLM agent systems is often realized via multi-LoRA, where agents share a pretrained backbone and differ only by lightweight adapters.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language

Aug 21

ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents

arXiv:2608. 19662v1 Announce Type: new Abstract: Agentic language models repeatedly encode tool and skill schemas that recur across requests in different combinations and orders, preventing standard prefix caching from reusing their key--value (KV) states.

By Yichu Fang, Sitong Wei, Haozhe Hu, Xiaoyu Shen

llms agents nlp efficiency benchmarks

arXiv AI

Aug 18

Learning Agent Execution for KV-Cache Management in Agentic Serving

arXiv:2608. 14624v1 Announce Type: new Abstract: Multi-agent LLM systems have emerged as an important deployment paradigm for AI services, where each user request is decomposed into a sequence of specialized agents.

By Rui Zhang, Chaeeun Kim, Shaoting Feng, Kuntai Du, Yuhan Liu, Yi Zhong, Cheng-Wei Ching, Junchen Jiang, Liting Hu

llms agents efficiency

arXiv AI

Jun 6

RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

arXiv:2606. 06256v1 Announce Type: new Abstract: As the input length of large language model (LLM) serving continues to grow, the KV cache has become a dominant bottleneck in AI infrastructure.

By Yang Liu, ZhaoKai Luo, HuaYi Jin, ZhiYong Wang, RuoZhou He, BoYu Wang, Guanjie Chen, Junhao Hu

llms fine-tuning efficiency

arXiv AI

Aug 11

SemPIC: Learning Semantic Position-Independent KV Caches

arXiv:2607. 28069v2 Announce Type: replace Abstract: Long-context retrieval and agentic workloads repeatedly reuse the same documents under changing instructions, histories, and document orders.

By Hui Xie, Peng Xiao, Yutong Deng, Shuoran Dou, Jian Yang, Jinyang Guo

agents fine-tuning efficiency

arXiv AI

3d ago

Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

arXiv:2609.32259v2 Announce Type: replace Abstract: Recent multi-agent LLM systems increasingly combine heterogeneous models for specialized agent roles. However, text-based communication requires ea...

By Vincent-Daniel Yun, Woosang Lim, Haneul Yoo, Sungjoo Yoo, Murali Annavaram, Sai Praneeth Karimireddy

llms agents nlp efficiency benchmarks

arXiv AI

Jul 24

Workload-Aware Caching for Multi-Agent Systems

arXiv:2607. 20495v1 Announce Type: new Abstract: Multi-agent systems decompose complex tasks into directed acyclic graphs (DAGs) of specialized agent executions, creating natural opportunities for caching intermediate results across queries.

By Anas Mohamed, Kaizan Haque, Azal Ahmad Khan, Chetan Sharma, Shuwen Ge, Ali Anwar

agents benchmarks

One email a morning, machine-written

Related stories

ReCache: Efficient KV Cache Reuse and Compression for Tool-Augmented LLM Agents

Learning Agent Execution for KV-Cache Management in Agentic Serving

RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

SemPIC: Learning Semantic Position-Independent KV Caches

Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

Workload-Aware Caching for Multi-Agent Systems