EpiSEM-Bench: Evaluating Safety and Evidence Recovery in LLM Agents under Missing Evidence

EpiSEM-Bench is an executable benchmark designed to assess how language‑model agents handle missing safety‑relevant evidence. It comprises 300 matched unsafe/safe task pairs across six domains, systematically suppressing critical facts to measure unsafe execution and failure cardinality. An independent audit tool evaluates whether agents seek missing facts and withhold prohibited actions while completing permissible tasks, revealing variation among ten models in omission robustness, evidence acquisition, and appropriate action.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

• llms
• agents
• benchmarks
• safety