arXiv AI

AEGIS: A Backup Reflex for Physical AI

arXiv:2606. 06660v1 Announce Type: new Abstract: Long-horizon robot manipulation tends to fail gradually: one bad step degrades the state, and the policy spirals into a basin from which it cannot recover.

arXiv AI
Oct 12

RESCUE: Is This Alarm Worth Acting On? Counterfactual Evaluation of VLA Runtime Monitors

The paper introduces RESCUE, a counterfactual framework that evaluates whether runtime monitors for robot policies generate alarms that lead to useful interventions. By restoring simulator and policy states at checkpoints, RESCUE compares alternative actions to identify the latest checkpoint that satisfies a recovery criterion and measures whether acting on alarms reduces expected task‑completion cost. Experiments on OpenVLA‑OFT and π0.5 over LIBERO‑Spatial and LIBERO‑Plus show that recoverability depends on the state–intervention pair, and that even an ideal detector can only tolerate a 2.0–3.3% false‑alarm rate before unnecessary resets outweigh early failure stops.

By David Ahmedt-Aristizabal, Abdelwahed Khamis, Mohammad Ali Armin, Lars Petersson
arXiv Machine Learning
Oct 9

Diagnosing and Recovering from Observation-Space Shift at Long-Horizon Skill Seams

The paper investigates Observation‑Space Shift (OSS), a failure mode in long‑horizon robotic manipulation where downstream skills start from states altered by preceding skills. By diagnosing that displaced scene elements—not robot joints or target objects—cause most OSS, the authors develop a detect‑restore‑resume system that monitors task progress, restores the scene, and fine‑tunes the skill to resume. On the BOSS‑44 benchmark, this approach raises full‑chain success from 7.6 % to 26.5 %, outperforming several baselines and demonstrating the value of scene restoration before policy resumption.

By Pranav Wagh, Yu Fang, Yue Yang, Mingyu Ding
arXiv AI
Sep 4

Instruction Duplication as an Inference-Time Control Primitive

The paper introduces instruction duplication, a simple inference‑time control that repeats the procedural instruction without retraining or decoding changes. Across seven instruction‑tuned models and 16,800 scheduled generations, duplicating the instruction improves deterministic All‑8 diagnostic‑response success from 90.22% to 93.17% and reduces failures by 30.2%. In downstream Answer Engineering scenarios, duplication further boosts success rates, demonstrating its practical impact on systems that rely on the generated trajectory.

By Victor Lavrenko (PeaceTech VC, Israel)
arXiv Machine Learning
Oct 8

CARE: Certifying Acceleration for Vision-Language-Action Inference

The paper introduces CARE, a method for certifying accelerated inference in vision‑language‑action models. CARE uses paired rollouts on a calibration set to guarantee that the risk of acceleration‑induced failure stays below a user‑specified budget, selecting the fastest certified accelerator or falling back to the reference policy. Experiments on LIBERO suites show that CARE achieves 9.0–10.8× speedups while preserving at least 85.8% of reference‑solved episodes with 95% confidence, and it outperforms non‑guaranteed selectors in both budget adherence and rollout efficiency.

By Rui Liu, Tong Zheng, Jindong Gu, Zhipeng Wang
arXiv Machine Learning
Oct 2

When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models

The paper investigates a specific failure mode in vision‑language‑action models, termed instruction‑action binding, where models respond to language and vision separately but fail to combine them to select the correct action under counterfactual changes. Through behavioral analyses of fine‑tuned policies, the authors show that failed rollouts often preserve source behavior or switch to other demonstrated tasks, indicating that language is not ignored but mis‑bound. They propose Equivariant Counterfactual Training (ECT), which supplies counterfactual demonstrations and a paired loss to enforce correct action selection, achieving significant performance gains across simulated and real‑world benchmarks.

By Hung-Jen Chen, Yu-Hsun Hou, Yan-Hong Chen, Yan-Fu Chen, Binghua Cai, Min Sun, Chun-Yi Lee
arXiv Machine Learning
Aug 4

Real-Time Detection and Repair of LLM Agent Failures

arXiv:2608. 02464v1 Announce Type: cross Abstract: LLM agents fail mid-episode -- they loop, cascade tool errors, drift off goal, fabricate results, or silently absorb corrupted content -- and the standard remedy, judging every step with a second LLM, costs more than the agent itself.

By Sunny Dubey
arXiv AI
Aug 19

An Omitted Mode Is a Rare Rule: The Sampling-Verification Danger Law in Continuous Code World Models

The paper investigates the safety of Code World Models, where a language model generates executable world models that a planner uses. It shows that accepting a model based on sampled transitions only guarantees sample consistency, not full safety, because the probability of missing critical events decays as (1‑r)^N. Experiments on hybrid instruments reveal that omitted mode‑boundaries can severely limit planner performance, and that even sophisticated LLMs (GPT‑5.x) struggle to repair such omissions in higher‑dimensional settings.

By Javier Aguilar Mart\'in
Hugging Face Trending Papers
Sep 3

Instruction Duplication as an Inference-Time Control Primitive

Instruction duplication is a simple, inference‑time control that repeats the procedural instruction in a language‑model output without retraining or decoding changes. In experiments across seven instruction‑tuned models on 300 medical multiple‑choice questions, duplicating the instruction increased the proportion of deterministic All‑8 diagnostic‑responses from 90.22 % to 93.17 % and reduced failures by 30.2 %. The technique also improved pre‑provisional TF‑IDF recall and, in downstream Answer Engineering scenarios, significantly raised success rates for specific endpoints.