arXiv Computer Vision
Oct 22

DetM-Tracker: Deterministic and Memory-Efficient VIS for Autonomous Industrial Inspection

DetM-Tracker is a lightweight Video Instance Segmentation framework designed for autonomous industrial inspection. It reduces memory and computation by condensing instance features into four-scalar descriptors, dynamically allocating query capacity, and using entropy-gated skip connections to focus processing on uncertain regions. The method achieves roughly 20× lower inference latency and 6× less VRAM usage than dense-feature baselines.

By You-Rui Lin, Jen-Chieh Wu, Tzu-Ti Wei, Jen-Jee Chen, Yu-Chee Tseng
arXiv Computer Vision
Oct 23

UniMem: Unifying Visual and Textual Memory in VLAs for Non-Markovian Tasks

UniMem is a framework that unifies visual and textual memory with low‑level control in a single Vision‑Language‑Action model, using an event classifier, keyframe encoder, and caching to manage memory efficiently. It addresses non‑Markovian tasks that require remembering past scenes, avoiding the memory bottleneck of separate VLMs and the performance drop from fixed‑interval frame sampling. Across five simulation and four hardware tasks, UniMem outperforms fixed‑interval sampling (93.4% vs. 68.2%) and hierarchical VLM‑VLA baselines (80.0% vs. 43.5%) while offering faster inference and a simpler training pipeline.

By Lars Osterberg, Maggie Wang, Mac Schwager
arXiv AI
Sep 17

Visual Perception Engine: Fast and Flexible Multi-Head Inference for Robotic Vision Tasks

Visual Perception Engine (VPEngine) is a modular framework that enables efficient GPU usage for robotic vision tasks by sharing a foundation model backbone across multiple specialized task heads. It eliminates redundant feature extraction, supports dynamic task prioritization, and achieves up to 3× speedup over sequential execution. The open‑source Python implementation, with ROS2 C++ bindings, delivers real‑time performance (≥50 Hz) on NVIDIA Jetson Orin AGX using TensorRT‑optimized models.

By Jakub {\L}ucki, Jonathan Becktor, Georgios Georgakis, Rob Royce, Shehryar Khattak
arXiv Computer Vision
Sep 7

LUMIN: Lightweight Universal Manufacturing Inspection Network for Anomaly Detection

The paper introduces LUMIN, a lightweight network for manufacturing anomaly detection, and PSP, a four‑stage adaptive memory bank sampling pipeline that eliminates backbone forward passes. PSP achieves near‑random construction speed, 341× faster than FPS, while parallel similarity computation and stratified pixel sampling cut inference time by 20× with minimal accuracy loss. Experiments on five benchmarks show that LUMIN and PSP reach state‑of‑the‑art sampling accuracy with dramatically reduced latency and memory usage.

By Pengfei Yang