arXiv AI

Adaptive World-Models for Anomaly Recognition (AWARE): A Framework for Robot Dynamics Prediction and Introspection

The paper introduces AWARE, a world‑model framework that detects anomalies in robotic systems using only external camera data for dynamics estimation and state prediction. Tested on 240 real‑world crane trajectories, AWARE outperforms the best baseline by 26% in anomaly classification under noisy, camera‑only conditions. It also decodes dynamics parameters to pinpoint fault sources, achieving 88% accuracy in localizing motor degradation.

arXiv Computer Vision
4d ago

Spatiotemporal Dynamics-Aware Industrial Anomaly Detection and Reasoning

The paper introduces MUSTARD, a multimodal spatiotemporal anomaly detection framework for industrial products that enhances large language models with fine‑grained motion awareness. It uses optical‑flow‑guided keyframe selection and augmented modalities to capture both local motion patterns and global dynamic evolution, enabling detection and reasoning of dynamics‑based defects with only a few normal reference samples. Experiments show that MUSTARD outperforms existing methods in identifying spatiotemporal anomalies and offers interpretable explanations.

By S-Wei Chen, Siangyu Yang, Yi-Chen Jan, Chun-Yi Lee, Shao-Yuan Lo
Hugging Face Trending Papers
4d ago

Spatiotemporal Dynamics-Aware Industrial Anomaly Detection and Reasoning

The paper introduces MUSTARD, a multimodal spatiotemporal anomaly detection framework that enhances large language models with fine‑grained motion awareness for industrial defect detection. It uses optical‑flow‑guided keyframe selection and augmented modalities to capture local motion patterns and global dynamic evolution, enabling detection of dynamics‑based anomalies without model updates. Experiments show that MUSTARD outperforms existing methods in identifying spatiotemporal defects and offers interpretable explanations.

arXiv Machine Learning
Sep 16

Robust Fault Detection in Mechanical Multimodal Time Series via Self-Supervised Cross-Modal Reconstruction

The paper introduces a multimodal anomaly detection framework that uses cross‑modal reconstruction of heterogeneous time‑series sensor data to detect faults in industrial systems. By learning to reconstruct each modality from the others, the method leverages complementary information across sensing channels without requiring explicit temporal alignment or identical sampling rates. An adaptive test‑time thresholding mechanism further improves robustness to distribution shifts caused by changing operating conditions, as demonstrated by strong fault detection performance in three industrial case studies, especially under out‑of‑distribution regimes.

By Magnus Munk Jensen, Dorte Hammersh{\o}i, Rafa{\l} Wi\'sniewski, Olga Fink
arXiv AI
Sep 17

RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos

RoboVAD is a large-scale benchmark for video anomaly detection in robotic arm manipulation, featuring cross-domain evaluation where both tasks and anomaly types are unseen during training. The dataset challenges existing VAD methods, with state-of-the-art approaches, including a new method tailored for robotic arms, still achieving less than 70% micro-averaged frame-level AUC in the hardest setting. The authors provide the dataset and code publicly for further research.

By Alexandru-Bogdan Dura, Sebastian Balmus, Radu Tudor Ionescu
arXiv Machine Learning
Sep 25

Continuous Online Fault Detection for Mobile Robots via Adaptive Edge Models

The paper presents a Teacher-Student distillation framework for continuous online fault detection in mobile robots. An offline foundation model (TSPulse) generates pseudo‑labels from augmented time‑series data, while a lightweight MiniRocket Student, enhanced with a Recursive Least Squares estimator, performs real‑time inference with a 4.30 ms CPU latency. The Student adapts online to domain shifts, improving VUS‑PR scores from 0.26 to 0.75 and uses an uncertainty‑guided active learning strategy to request minimal operator interventions.

By Jordan Levy, Nicolas Verstaevel, Vincent Talon, Benoit Gaudou