arXiv AI By Tiehan Cui, Peipei Liu, Yanxu Mao, Gaosheng Wang, Mingzhe Xing, Datao You

NEXUS: Learning Safety Constraints and Action Models for Safe and Robust Embodied Planning

Read the original on arXiv AI →

NEXUS is a modular neuro‑symbolic framework that simultaneously learns a PDDL domain model and an LTL safety specification for embodied agents. It repairs action schemas using execution failures and converts detected hazards into reusable LTL constraints via hierarchical semantic and translation sampling. During symbolic search, LTL progression enforces these constraints, allowing the system to differentiate between physically unreachable states and safety‑induced refusals, and experiments on SafeAgentBench demonstrate superior safety‑task completion and low violation rates even under jailbreak attacks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 17

SafeRelBench: A Spatial-Relation-Aware Benchmark for Process-Level Safety in VLM-Driven Embodied Agents

arXiv:2607. 14543v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly used as the reasoning backbone of embodied agents, enabling robots to interpret visual scenes, follow language instructions, and plan multi-step actions.

By Huaigang Yang, Ya Li, Min Ren, Bo Dai, Zhenliang Zhang, Zhaofeng He
arXiv AI
Jul 22

SENTINEL: A Multi-Level Formal Framework for Safety Evaluation of Foundation Model-based Embodied Agents

arXiv:2510. 12985v3 Announce Type: replace Abstract: We present SENTINEL, a framework for formally evaluating the physical safety of foundation model (FM)-based embodied agents.

By Simon Sinong Zhan, Philip Wang, Yao Liu, Yiyan Peng, Zinan Wang, Qineng Wang, Zhian Ruan, Xiangyu Shi, Xinyu Cao, Frank Yang, Zhenyang Ni, Kangrui Wang, Ruohan Zhang, Huajie Shao, Manling Li, Qi Zhu
arXiv Computation and Language
Aug 31

CEDAR: Automata as Verifiable Interfaces for Language-Guided Embodied Action

CEDAR is a counterexample-guided framework that translates natural-language instructions for embodied agents into regular languages over environment event traces, represented as deterministic finite automata. By using a language model for semantic judgments and execution traces for correction, CEDAR turns constraints into executable finite-state objects, enabling the intersection of learned skills with additional specifications. In Minecraft experiments, CEDAR preserves temporal and spatial constraints better than a program-generating baseline and reduces cumulative LLM queries by reusing learned skills.

By Lekai Chen, Alvaro Velasquez, Ashutosh Trivedi
Hugging Face Trending Papers
Aug 20

SafeBranch: Branch-Pair Safety Alignment for Embodied Agents

Vision-language-model-based embodied agents can complete instructed tasks but often violate safety constraints in the process, a problem recently framed as interactive safety. Training such agents to act safely is difficult, since safety and task success are distinct objectives, and safety arises only at a small number of safety-critical steps within a trajectory.