arXiv AI
MMedAgent-Plus: Scaling Multimodal Medical Agents across Modalities, Tasks and Workflows
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 2
AutoMedBench: Towards Medical AutoResearch with Agentic AI Models
arXiv:2606. 01961v1 Announce Type: new Abstract: Autonomous agents are increasingly expected to support end-to-end medical-AI research workflows, moving beyond isolated prediction tasks or short-form clinical question answering.
arXiv AI
Oct 9
MedBenchAgent: Towards Systematic Automation of Medical VLM Benchmark Construction
MedBenchAgent is a multi‑agent framework that automates the entire process of constructing medical vision‑language model benchmarks, from deriving the benchmark specification to generating and auditing evaluation items. It uses a Benchmark Intermediate Representation (BIR) to encode task definitions, evidence mappings, evaluation protocols, and item specifications, separating planning from instantiation. The system achieves a Task‑Space F1 of 90.9% and demonstrates high audit pass rates, outperforming existing task induction methods and showing portability across specialized medical domains.
arXiv AI
Jun 11
Human-Guided Agentic AI for Multimodal Clinical Prediction: Lessons from the AgentDS Healthcare Benchmark
arXiv:2602. 19502v2 Announce Type: replace Abstract: Agentic AI systems are increasingly capable of autonomous data science workflows, yet clinical prediction tasks demand domain expertise that purely automated approaches struggle to provide.
arXiv AI
Jun 11
MedCTA: A Benchmark for Clinical Tool Agents
arXiv:2606. 11702v1 Announce Type: cross Abstract: To make clinically grounded decisions, medical AI agents are expected to go beyond simple recognition and be capable of tool retrieval, evidence acquisition, and integration.
arXiv AI
Aug 25
ATP-Bench: Towards Agentic Tool Planning for MLLM Interleaved Generation
ATP‑Bench proposes a new benchmark for evaluating agentic tool planning in multimodal large language models (MLLMs) that generate interleaved text-and-image responses. The benchmark contains 7,702 QA pairs, including 1,592 visual‑question‑answer pairs, across eight categories and 25 visual‑critical intents, all verified by humans. A Multi‑Agent MLLM‑as‑a‑Judge (MAM) system is introduced to assess tool‑call precision, missed opportunities, and overall response quality without relying on ground‑truth references.
arXiv AI
Oct 1
OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software
OSWorld-Science is a benchmark and evaluation environment for computer-using agents that use visual language models (VLMs) to perform scientific software tasks. It includes 12 VLMs and 146 high-quality tasks across domains such as molecular drawing, pathology image analysis, statistical computing, and physical simulation, with artifact-based evaluation and a harness that logs interactions and supports model comparison. The benchmark was developed through expert proposals and iterative human–AI co‑design, and results show that current VLMs still struggle with key scientific questions, offering insights into factors like language, reasoning, and context length.