Benchmark Everything Everywhere All at Once
arXiv:2606. 06462v1 Announce Type: new Abstract: Benchmarks are fundamental for evaluating and advancing LLMs and MLLMs by providing standardized and explicit measures of performance.
arXiv:2505. 16120v3 Announce Type: replace Abstract: The emergence of Large Language Models (LLMs) has reshaped agent systems.
arXiv:2606. 06462v1 Announce Type: new Abstract: Benchmarks are fundamental for evaluating and advancing LLMs and MLLMs by providing standardized and explicit measures of performance.
arXiv:2607. 28629v1 Announce Type: new Abstract: The rapid transition from reactive large language models (LLMs) to persistent, action-capable systems has exposed critical gaps in the architectural understanding of Agentic AI, particularly in separating inference, orchestration, and execution layers for autonomous AI agents.
arXiv:2606. 02862v1 Announce Type: new Abstract: The rise of Large Language Models (LLMs) has enabled agentic AI capable of complex reasoning and tool use; however, deploying such autonomy in pervasive computing environments remains challenging due to the strict memory and energy constraints of embedded microcontrollers.
The paper introduces a multi‑agent platform built on CrewAI for conversational business intelligence. Five specialized agents process natural language queries, retrieve and analyze data, generate visualizations via the Model Context Protocol, and deliver actionable insights. The system includes a defense‑in‑depth security architecture, a query parameterization mechanism, and achieves 95.3% functional accuracy with a 24‑second mean latency, outperforming a single‑agent baseline by 22.6 percentage points in accuracy and 20.2% in quality.
arXiv:2605. 30407v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated strong performance on general tasks, while often struggling to adapt to specialized domains without high-quality domain-specific data.
arXiv:2608. 15591v1 Announce Type: new Abstract: Large Language Model (LLM) agents deployed in production environments face a fundamental tension: the agent's behavior is frozen at deployment time, while the business rules and edge cases it must handle continue to evolve.
arXiv:2607. 05174v1 Announce Type: new Abstract: Language agents, i.
The article surveys LLM-based agentic reasoning frameworks, presenting a unified formal language that categorizes them into single-agent, tool-based, and multi-agent methods. It reviews application scenarios in scientific discovery, healthcare, software engineering, society, economics, and general-purpose tasks, and compares the distinct features and evaluation strategies of each category. The survey highlights the rapid development of complex agentic systems in real-world contexts.
The paper surveys how large multimodal models (LMMs) enhance agentic frameworks that combine perception, memory, reasoning, planning, and action. It examines the integration of multiple modalities—text, images, audio, and video—through delegated, late‑fusion, and early‑fusion architectures, and maps these designs to agent capabilities. The survey also reviews multimodal agentic systems in robotics, web navigation, multimedia content creation, and video understanding, evaluating performance, efficiency, and scalability trade‑offs.
Brain-Computer Interfaces (BCIs) and brain signal understanding are pivotal for clinical health and next-generation interactions. Despite this significance, its widespread adoption in real-world scenarios remains restricted, primarily because current analytical paradigms lack sufficient agentic intelligence.
arXiv:2606. 16307v1 Announce Type: new Abstract: Training tool-augmented LLM agents requires large corpora of multi-turn, tool-grounded conversational data that is expensive to annotate, privacy-constrained in production settings, and largely absent from public datasets.
arXiv:2609.24137v1 Announce Type: cross Abstract: Traditional data systems face profound limitations in the AI era, relying on human-crafted pipelines, lacking semantic understanding of heterogeneous...