arXiv AI

Making Self-Driving Laboratories Auditable:A Unified Framework for Hybrid Actions,Measurements, and Safe Execution

The paper introduces a unified framework for self‑driving laboratories (SDLs) that integrates experimental planning, automated execution, and measurement feedback. It comprises four components: LAM, a measurement‑conditioned policy that generates robot trajectories and typed instrument API calls; OpenSDL, an execution substrate that maps operations to heterogeneous devices and records causal events; Safe‑SDL, a runtime gate that performs pre‑dispatch checks and monitors execution with signal temporal logic; and L3‑Bench, a benchmark protocol evaluating physical outcomes, timing, reproducibility, safety, and fault recovery. Together, these elements aim to address coordination and traceability challenges in SDL workflows.

arXiv Machine Learning
Oct 5

Mind the Refinement Gap: When Safe High-Level Robot Plans Produce Unsafe Executions

The paper examines a trace‑completeness assumption in language‑enabled robot systems that combine semantic‑graph planning with temporal‑logic safety monitors. By auditing RoboGuard, the authors compare the monitor’s verdict on a surface plan with its verdict on a graph‑refined trace under the same LTL specification. Their evaluation of 28 controlled cases and 14 end‑to‑end scenarios shows that all targeted abstraction cases exhibit the predicted surface‑versus‑refined discrepancy, while controls behave as expected, suggesting that graph‑based trace refinement can serve as a lightweight mitigation and diagnostic tool for physical‑AI safety monitors.

By Stabak Das, Priyesh Ranjan, Xiangfang Li, Lijun Qian
arXiv AI
Jun 12

LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories

arXiv:2606. 13578v1 Announce Type: cross Abstract: Scientific laboratories increasingly rely on AI systems to reason about experiments, but the physical act of doing science remains largely outside their reach.

By Baochang Ren, Xinjie Liu, Xi Chen, Yanshuo Liu, Chenxi Li, Daqi Gao, Zeqin Su, Jintao Xing, Zirui Xue, Rui Li, Xiangyu Zhao, Shuofei Qiao, Minting Pan, Wangmeng Zuo, Lei Bai, Dongzhan Zhou, Ningyu Zhang, Huajun Chen
arXiv AI
Sep 2

EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents

EmbodiedSkills is a unified framework that treats each skill decision as an execution proposal, checking prerequisites and verifying outcomes during long‑horizon vision‑language‑action tasks. It connects high‑level skill selection, bounded low‑level VLA execution, and post‑action verification through a fixed executable‑skill interface, enabling easy replacement of low‑level policies and recording of structured trajectories for supervision and adaptation. Instantiated with Qwen3‑VL and OpenPI/pi0.5 on RoboTwin 2.0 and LIBERO, the framework achieves high success rates (86.20% and 97.40% respectively) and demonstrates effective memory‑dependent task performance.

By Wei Wang, Wenqiao Zhang, Yutong Lin, Yuqian Yuan, Tianwei Lin, Jinhao Mao, Zhenxuan Fan, Mingjian Gao, Yang Dai, Wentong Li, Zheqi Lv, Zheng Dong, Yingjie Niu, Jiaqi Zhu, Jun Xiao, Chao Li, Yueting Zhuang
arXiv AI
Oct 19

From Natural Language Intent to Executable Control: Hierarchical Feedback-Guided LLM Planning for Multi-component Cyber-Physical Systems

The paper introduces a hierarchical feedback framework that guides large language models (LLMs) to produce executable plans for cyber‑physical systems (CPSs) from natural language commands. It prompts LLMs to generate both a structured task plan and signal temporal logic (STL) constraints, then uses a sound algorithm to detect contradictions and provide feedback for plan revision. At execution time, diagnostic information from failed control synthesis—such as violated constraints and conflicting component assignments—is fed back to the LLM to enable task replanning, achieving an 87.9% success rate on seven heterogeneous CPS scenarios.

By Jinglin Dai, Jiawan Wang, Ruiqi Hong, Lei Bu
arXiv Computer Vision
Oct 16

CarryOn: A Dual-Loop Harness for Personalized and Reliable Robot Assistance

CarryOn is a dual-loop system that enhances frozen vision‑language‑action (VLA) policies for robotic assistance by adding personalization and reliable execution. The planning loop maintains persistent user and scene context to ground subtask decomposition in user preferences, while the execution loop supervises policy rollouts to prevent hazardous contact and recover from failures using reusable control skills. Experiments on a real robot and in simulation show that CarryOn reduces safety violations from 52.6% to 6.1% and increases recovery success from 13% to 80%.

By Zixuan Wang, Yuqi Liu, Yuxin Chen, Sengqiao Yang, Jinhui Ye, Pengguang Chen, Changsheng Lu, Shu Liu, Bei Yu, Jiaya Jia
arXiv AI
Sep 28

A Safety-Bounded SDC-to-MCP Gateway for Medical AI Agents

The paper introduces a safety‑bounded gateway that translates IEEE 11073 Service‑Oriented Device Connectivity (SDC) into the Model Context Protocol (MCP) for medical AI agents. It exposes device metrics, alarms, context references, and semantic metadata as read‑only resources, while representing selected action affordances as policy‑validated dry‑run tools, ensuring that agent requests never trigger actual device operations. A Python prototype demonstrates fault and lifecycle experiments, deterministic baselines, and multi‑model agent evaluation, showing improved semantic conformity and preservation of the no‑execution boundary.

By Bennet Gerlach, Stefan Fischer
arXiv AI
Jul 22

SENTINEL: A Multi-Level Formal Framework for Safety Evaluation of Foundation Model-based Embodied Agents

arXiv:2510. 12985v3 Announce Type: replace Abstract: We present SENTINEL, a framework for formally evaluating the physical safety of foundation model (FM)-based embodied agents.

By Simon Sinong Zhan, Philip Wang, Yao Liu, Yiyan Peng, Zinan Wang, Qineng Wang, Zhian Ruan, Xiangyu Shi, Xinyu Cao, Frank Yang, Zhenyang Ni, Kangrui Wang, Ruohan Zhang, Huajie Shao, Manling Li, Qi Zhu
arXiv AI
Jun 30

BioProVLA-Agent: An Affordable, Protocol-Driven, Vision-Enhanced VLA-Enabled Embodied Multi-Agent System with Closed-Loop-Capable Reasoning for Biological Laboratory Manipulation

arXiv:2605. 07306v2 Announce Type: replace-cross Abstract: Biological laboratory automation can reduce repetitive manual work and improve reproducibility, but reliable embodied execution in wet-lab environments remains challenging.

By Zhaohui Du, Zhe Wang, Hongmei Fei, Xiwen Cao, Ting Xiao, Qi Wang, Huanbo Jin, Jiaming Gu, Quan Lu, Zhe Liu
arXiv AI
Jul 28

OS-Sentinel: Towards Safety-Enhanced Mobile GUI Agents via Hybrid Validation in Realistic Workflows

arXiv:2510. 24411v3 Announce Type: replace Abstract: Computer-using agents powered by Vision-Language Models (VLMs) have demonstrated human-like capabilities in operating digital environments like mobile platforms.

By Qiushi Sun, Mukai Li, Zhoumianze Liu, Zhihui Xie, Fangzhi Xu, Zhangyue Yin, Kanzhi Cheng, Zehao Li, Zichen Ding, Qi Liu, Zhiyong Wu, Zhuosheng Zhang, Ben Kao, Lingpeng Kong