Hugging Face Trending Papers
POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
1d ago
POLAR: Ontology-Guided Risk Prevention for Tool-Calling LLM Agents
POLAR is a guardrail framework designed for small tool‑calling language‑model agents that evaluates the reversibility of each action using a two‑layer ontology. By assigning graded reversibility scores and pruning calls that fall below a threshold, POLAR aims to prevent operational risks before they occur. In experiments on the τ²‑bench across six agent models, POLAR increased mean task reward by 0.11 to 0.18 points on airline tasks for four of six agents, though improvements were limited to eight of eighteen model‑domain cells, with some domains showing regression.
arXiv AI
Jun 6
From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents
arXiv:2606. 05805v1 Announce Type: new Abstract: LLM-based guardrails typically safeguard agents by evaluating proposed actions or inputs before execution, producing safety signals such as binary allow/deny decisions, risk categories, and/or explanatory rationales about potential policy violations.
arXiv AI
Aug 7
DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model
arXiv:2608. 05695v1 Announce Type: new Abstract: As large language model (LLM) agents increasingly invoke external tools and interact with real-world systems, unsafe actions may cause irreversible consequences on external states, user data, and downstream services.
arXiv AI
Aug 5
$S^3$: Improving Agent Safety through Multi-Stage Defense
arXiv:2608. 02683v1 Announce Type: cross Abstract: Large Language Model (LLM) agents rely on multi-stage agentic workflows, with stages such as memory, planning, and tool execution, to accomplish complex tasks.
arXiv AI
Sep 10
AURA-Eval: Evaluation Framework for Acting Under Risk Awareness in LLM Agent Trajectories
arXiv:2609.06783v1 Announce Type: cross Abstract: LLM agents operate in workflows where unsafe actions can have real consequences. Existing safety evaluations often reduce behavior to a single score,...
arXiv AI
Jun 10
PreAct-Bench: Benchmarking Predictive Monitoring in LLMs
arXiv:2606. 09890v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed as autonomous agents capable of executing multi-step action trajectories toward a given objective.