CoMemBench: Benchmarking Collaborative Memory Boundaries across Multi-Agent Workflow Topologies
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
The Flow has not summarised this story yet — read it at arXiv AI.
The paper introduces TOCOMAS, a Topology‑Coherent Multi‑Agent System that enforces topological coherence—consistent responsibility, handoff, and memory boundaries—within self‑evolving multi‑agent systems. TOCOMAS grounds task graphs in tool interfaces, groups compatible task nodes into reusable responsibility domains, and derives collaboration and memory visibility rules that respect task dependencies. In experiments on BBEH, WorkBench, SWE‑Bench‑Verified, and CoMemBench, TOCOMAS outperforms baseline methods in task success, verified progress, handoffs, and memory isolation.
arXiv:2607. 09493v1 Announce Type: new Abstract: Agentic LLM systems that generate code through multi-turn tool use face a fundamental context problem: each session starts from zero, discarding the configuration choices, domain constraints, data schemas, and tool-use patterns that made previous sessions productive.
MemCo introduces a memory‑centric collaboration framework that equips large language model agents with both local and global memory spaces. Local memory preserves environment‑specific details, while global memory captures transferable workflows from local trajectories. During online interaction, MemCo selectively routes relevant memories based on the agent’s state and decision phase, enabling reuse of other agents’ experiences without over‑generalizing environment‑specific information.
arXiv:2606.00756v2 Announce Type: replace Abstract: LLM-based Web agents are increasingly deployed on edge servers to carry out long-horizon tasks on behalf of users with low latency. However, the li...
WorkflowOps is a multi‑agent workflow orchestration framework that learns collaboration priors from historical workflows. It uses a transition probability matrix to guide DAG construction, a sufficiency‑driven loop to create new agents on demand via an LLM, and a layered semantic matching strategy to reduce LLM calls. Experiments show that WorkflowOps improves end‑to‑end pass rates, especially on structured, decomposable tasks.
MASBench is a benchmark for evaluating large language model (LLM)-based multi‑agent systems (MAS) under partial observability, a realistic constraint where agents only see limited environmental information. The benchmark is structured into three progressive task categories—Reasoning, Scheduling, and Game—and assesses three collaboration mechanisms: Protocol, Memory, and Routing. It provides deterministic evaluation metrics such as performance score, communication cost, and cost effectiveness, and includes empirical results across various LLM backbones to guide effective MAS design.