arXiv AI By Humza Nusrat, Kundan Thind

OpenGray: a benchmark for evaluating the decisions of radiotherapy planning agents

Read the original on arXiv AI →

OpenGray is a new benchmark that evaluates radiotherapy planning agents on their decision-making rather than just dose outcomes. It extends the OpenKBP-Opt head-and-neck dataset with tasks that have known correct decisions, including contradictions with dose goals and a feasible control plan. Four systems—ranging from a rule-based script to full LLM agents—were tested on 30 patients, revealing that high decision accuracy can mask specific failures such as missed hard goals and inadequate stopping actions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 7

RadOnc-Agent: An LLM-Orchestrated Framework for AI Workflows Across the Radiotherapy Care Pathway

RadOnc-Agent is an AI framework that organizes radiotherapy into four clinical phases and offers 26 callable functions via a conversational interface. A large‑language‑model controller maps clinical intent to schema‑constrained calls, maintains patient and workflow context, and routes requests to specialist services. In evaluations, the system achieved high accuracy in single‑function calls (98.79%) and cross‑stage workflow completions (96.50% scripted, 96.67% real‑patient), demonstrating technical feasibility of LLM‑orchestrated coordination across heterogeneous radiotherapy capabilities.

By Caiwen Jiang, Shuoyang Wei, Songlin Zhao, Junyu Li, Jingyuan Chen, Wei Liu
arXiv AI
Oct 23

An Evidence-Driven Multi-Agent Compound AI System for Head and Neck Proton Radiotherapy Planning

The paper presents an evidence-driven, multi-agent AI system for head and neck proton radiotherapy planning. It combines a DRL-based planning agent that generates multiple treatment plans with an LLM-based conversational agent that refines the chosen plan through natural language interactions. The system, trained on 21 patients, improves instruction-following and domain-specific reasoning, yielding more clinically appropriate trade-offs in patient-specific plan refinement.

By Qingqing Wang, Liqiang Xiao, Chang Chang
arXiv AI
Jul 28

Comparing Optimization Models for Radiotherapy Scheduling

arXiv:2607. 22539v1 Announce Type: cross Abstract: The Radiotherapy Scheduling Problem (RTSP) involves determining an optimal schedule for patients undergoing radiation treatments, a task that has a massive impact on clinical outcomes given the central role of radiotherapy in cancer care.

By C. C. Rambaldi Migliore, D. Stanicel, N. Musliu, G. Iacca, M. Roveri
arXiv AI
Aug 28

AgentJudgeBench: A Multi-Difficulty Benchmark for Evaluating LLM Judges on Agentic Tool-Calling

AgentJudgeBench is a new benchmark that evaluates the reliability of large language model (LLM) judges on agentic tool‑calling tasks involving workflow directed acyclic graphs (DAGs). It contains 3,808 instances across six DAG topologies and three difficulty tiers, tested with five generators (3B–70B open‑weight models and GPT‑5.4) and six judges (20B to frontier scale) under both paired‑with‑and‑without‑ground‑truth conditions. The study finds that judge alignment degrades with task difficulty, ground‑truth exposure can sometimes hurt alignment, and structured evaluation rubrics provide modest improvements, revealing a structural ceiling that model capacity alone cannot surpass.

By Abhigya Verma, Amit Kumar Saha, Seganrasan Subramanian, Sai Harshitha Aluru