Large language model (LLM) agents are beginning to automate machine learning engineering (MLE) by coupling planning, code execution, debugging, and empirical feedback. Translating this capability to medical imaging remains difficult because each task imposes modality-specific experimentation and strict requirements for validation protocols and prediction artifacts.
The paper introduces an agentic AI Scientist workflow that automates the entire baseline development process for medical imaging by combining literature-guided reasoning, automated code generation, and hypothesis-driven experimentation. Evaluated on four public benchmarks covering segmentation, classification, and detection, the pipeline consistently improves validation performance, achieving competitive leaderboard results such as 6th place on both PUMA tracks and 31st on MILK10k. The approach also shows strong domain generalization on MIDOG25 across scanners, tumor types, and species, demonstrating that a skill-based, literature-guided agentic workflow can reduce engineering effort without task-specific redesign.
By Eugenia Moris, Jos\'e Ignacio Orlando
arXiv:2608.29016v1 Announce Type: new
Abstract: Large language models (LLMs) have demonstrated considerable promise in program generation for small-scale and conventional application development; how...
By Zixiao Zhao, Jing Sun, Zhe Hou, Cheng-Hao Cai, Qian Liu, Mengze Li, Zijian Zhang, Jin Song Dong
arXiv:2604.16729v2 Announce Type: replace-cross
Abstract: State-of-the-art large language models (LLMs) show high performance in general visual question answering. However, a fundamental limitation r...
By Ayhan Can Erdur, Daniel Scholz, Jiazhen Pan, Benedikt Wiestler, Daniel Rueckert, Jan C. Peeken
arXiv:2606. 31179v1 Announce Type: new Abstract: As AI agents become increasingly capable of complex, long-horizon reasoning, rigorous and holistic evaluation is essential for measuring progress toward real-world healthcare applications.
By Qianchu Liu, Sheng Zhang, Guanghui Qin, Jeya Maria Jose Valanarasu, Maximilian Rokuss, Mingyu Lu, Timothy Ossowski, Juan Manuel Zambrano Chaves, Cliff Wong, Peniel Argaw, Yashna Hasija, Mu Wei, Wen-wai Yim, Qin Liu, Zilin Jing, Jason Entenmann, Naoto Usuyama, Tristan Naumann, Hoifung Poon
As AI agents become increasingly capable of complex, long-horizon reasoning, rigorous and holistic evaluation is essential for measuring progress toward real-world healthcare applications. We introduce HealthAgentBench, a suite of 54 agentic healthcare tasks across 7 categories each with its unique environment.