MedMemoryBench is a new benchmark designed to evaluate memory mechanisms in personalized healthcare agents, addressing the shortcomings of existing open‑domain conversation benchmarks. It uses a human‑agent collaborative pipeline to generate realistic, long‑horizon medical trajectories from synthetic patient archetypes, producing a dataset of roughly 2,000 sessions and 16,000 interaction turns. The benchmark introduces an "evaluate‑while‑constructing" streaming assessment protocol that mirrors dynamic memory accumulation in production, and it formally studies memory saturation—how continuous information influx can degrade retrieval and reasoning. The results highlight significant bottlenecks in current architectures, especially in complex medical reasoning and noise resilience, underscoring the need for more robust, production‑ready medical agents.
arXiv:2606. 31179v1 Announce Type: new Abstract: As AI agents become increasingly capable of complex, long-horizon reasoning, rigorous and holistic evaluation is essential for measuring progress toward real-world healthcare applications.
arXiv:2607. 15314v1 Announce Type: new Abstract: Healthcare spans high-stakes communication, expert reasoning, and workflow execution, yet specialized LLMs that cover these use cases together remain limited.
As AI agents become increasingly capable of complex, long-horizon reasoning, rigorous and holistic evaluation is essential for measuring progress toward real-world healthcare applications. We introduce HealthAgentBench, a suite of 54 agentic healthcare tasks across 7 categories each with its unique environment.
arXiv:2606. 09365v1 Announce Type: new Abstract: Medical agent systems are increasingly expected to support interactive clinical decision making rather than only static question answering.
Medical agent systems are increasingly expected to support interactive clinical decision making rather than only static question answering. In such settings, effective agents must reuse prior experience across evolving cases, yet existing memory mechanisms often retain raw historical traces that are redundant, noisy, and difficult to govern.
arXiv:2607. 09322v1 Announce Type: new Abstract: In this work, we introduce LongMedBench, a real-world EHR-based benchmark for long-horizon clinical decision-making.
MedResearcher‑R1 is a medical deep‑research agent that uses a Knowledge‑Informed Trajectory Synthesis (KISA) framework to build medical knowledge graphs and generate complex multi‑hop question‑answer pairs, especially for rare medical entities. It also incorporates a medical retrieval engine and general‑purpose tools to reliably synthesize medical evidence. The resulting 2,100+ trajectories across 12 specialties enable supervised fine‑tuning and reinforcement learning, producing a 32B model that outperforms larger proprietary systems on MedBrowseComp and shows strong performance on GAIA and xBench benchmarks.
PIA is a personal intelligence agent that works alongside a consumer health agent to convert health conversations into structured clinical records and to transform those records into a synthesized understanding of the user. It uses a memory system with four controls—extraction, memory, retrieval, and understanding—each supported by a health module that includes a schema, medical alias dictionary, knowledge graph, and temporal rules. The agent demonstrates that deeper memory injection—from simple recall to a health snapshot to a causal trajectory—yields progressively richer answers, while also revealing challenges such as missing self‑reported data, the influence of question phrasing, and the presence of structural noise in causal links.
ClinAgent is a conversational system that uses a ReAct-based LLM agent to retrieve and synthesize clinical trial information from multiple sources such as ClinicalTrials.gov, PubMed, and a local dataset. The agent iteratively reasons over user queries, selects appropriate tools, and refines its actions to provide grounded, up-to-date responses in natural language across multi-turn interactions. Evaluation across three phases shows that DeepSeek (thinking mode) excels in planning quality while Gemini 3.0 Flash delivers the highest overall performance and expert ratings, demonstrating the promise of agentic AI for improving clinical trial data access.
arXiv:2606. 18203v1 Announce Type: cross Abstract: The LLM-empowered personal health agents with user health (sensor) metrics have offered a promising pathway to alleviate global disparities in healthcare access.
arXiv:2605. 06177v2 Announce Type: replace Abstract: Reproducing and comparing deep research agents today is hard: the same backbone evaluated on the same benchmark can report different accuracies across papers because the harness and tool registry differ, and integrating a new model into a comparable evaluation surface costs weeks of model-specific engineering.
arXiv:2607. 13940v1 Announce Type: new Abstract: Personal health management unfolds over repeated encounters, yet most health AI systems treat each request in isolation.