The paper introduces K‑GAT, a neuro‑symbolic framework that generates multi‑agent collaboration topologies conditioned on external evidence, treating the design as a knowledge‑conditioned structure learning problem. Unlike prior methods that rely mainly on large language model parameters, K‑GAT integrates external evidence directly into autoregressive graph generation, reducing redundant interactions and improving verification in knowledge‑intensive tasks. Experiments on benchmarks such as the expert‑level GPQA dataset show K‑GAT achieving a +15.7% accuracy gain over the LLM‑Debate baseline while using fewer computational tokens.
LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption. Recent work on automatic topology design, ARG-Designer, has reframed this problem as autoregressive graph generation.
arXiv:2608. 20099v1 Announce Type: cross Abstract: LLM-based Multi-Agent Systems (MAS) achieve strong performance on complex reasoning tasks by coordinating multiple agents, but at the cost of substantial token consumption.
Unified-MAS is a two-stage framework that decouples node implementation from orchestration in Automatic Multi-Agent Systems. It first searches external knowledge to synthesize domain‑specific node blueprints, then uses a perplexity‑guided reward to optimize bottleneck nodes. Experiments across four specialized domains show that adding Unified-MAS to existing baselines improves performance‑cost trade‑offs by up to 14.2% while lowering costs.
arXiv:2605. 17361v2 Announce Type: replace-cross Abstract: Multi-agent systems (MAS) powered by large language models (LLMs) have emerged as a powerful paradigm for complex problem solving, where performance critically depends on the underlying inter-agent communication topology.
arXiv:2608. 12921v1 Announce Type: cross Abstract: The performance of large language model (LLM)-based multi-agent systems (MAS) largely depends on effective communication topologies.
arXiv:2608.29263v1 Announce Type: new Abstract: Large Language Models (LLMs) often suffer from hallucination and struggle with complex reasoning tasks requiring multi-hop domain knowledge. While inte...
The paper introduces SymbolLKG, a neuro-symbolic framework that combines a Logical Knowledge Graph (LKG) with dynamic solver routing to improve logical reasoning in large language models. The LKG represents logical rules and constraints as topological nodes, allowing explicit modeling of dependencies extracted from text. A Logic Router dispatches tasks to the most suitable symbolic engine, supported by a topology-aware hybrid retrieval mechanism, and the approach outperforms existing prompting and RAG baselines on logical reasoning benchmarks.
The paper introduces a method to improve test-time scaling (TTS) for large language models by using multi-agent systems (MAS) to split long reasoning chains into manageable contexts. A new dataset, M500, containing 500 multi-agent collaborative reasoning traces, is used to fine‑tune open‑source models, enabling them to learn collaborative patterns and outperform their base versions. An adaptive scaling strategy with a "CEO" agent is proposed to dynamically guide reasoning depth, and experiments in the AgentVerse framework confirm the effectiveness of the approach.
The paper introduces SymbolLKG, a neuro-symbolic framework that combines a Logical Knowledge Graph (LKG) with dynamic solver routing to improve logical reasoning in large language models. The LKG represents logical rules and constraints as topological nodes, enabling explicit modeling of dependencies extracted from text. A Logic Router dispatches tasks to the most suitable symbolic engine, supported by a topology-aware hybrid retrieval mechanism, and the approach outperforms existing prompting and RAG baselines on logical reasoning benchmarks.
arXiv:2607. 20268v1 Announce Type: new Abstract: While Large Language Models (LLMs) excel at many tasks, they frequently struggle with complex reasoning that requires long-horizon planning and iterative error correction.
arXiv:2511. 02687v2 Announce Type: replace Abstract: The trajectory of AI development suggests that we will increasingly rely on agent-based systems powered by language models, composed of independently developed agents with different information, privileges, and tools.
arXiv:2606. 16328v1 Announce Type: new Abstract: Large Language Models (LLMs) demonstrate remarkable potential in dynamic graph reasoning, but suffer from a scaling bottleneck: current models can only handle graphs with tens of nodes, constrained by exponential reasoning overhead and finite context windows.