arXiv Computer Vision

VkVIO: Cross-platform GPU Acceleration for Visual-Inertial Odometry with Vulkan

arXiv Computer Vision
1d ago

Lightweight and Resource-Efficient Perception for Robotic Guide Dogs

The paper examines how multi‑camera streaming perception systems perform on heterogeneous edge platforms that share resources with other workloads. Using two end‑to‑end pipelines on a single GPU–NPU platform, the authors show that isolated single‑stream evaluations can mislead deployment decisions: while the GPU pipeline appears superior in isolation, GPU‑local contention causes deadline misses that make detections stale and can reverse the preferred placement. The study finds that the NPU pipeline, though less accurate for small and medium objects, nearly matches the GPU on large objects, and that under high contention the best placement shifts from All‑GPU to All‑NPU, achieving a 5.2× improvement in worst‑stream sAP. The authors argue that evaluation metrics should include contention sweeps, deadline‑miss rates, and worst‑stream sAP in addition to mean sAP to capture severe single‑stream degradation.

By Jinse Kwon, Yoojin Lim, Choonghan Lee, Yongseung Yu, Yongin Kwon, Jemin Lee
arXiv AI
Aug 18

Efficient Block-Layer Parallel Inference for Vision-Language-Action on Hybrid Architectures

arXiv:2608. 14586v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are becoming a promising paradigm for autonomous driving, but their deployment on existing vehicle platforms remains difficult because they introduce both high inference latency and strong GPU-side resource pressure.

By Haibo HU, Lianming Huang, Qiao Li, Nan Guan, Chun Jason Xue
arXiv Computer Vision
Sep 18

AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend

AMB3R‑SLAM is a real‑time monocular SLAM system that can reconstruct kilometer‑scale trajectories over 10,000 frames on a single consumer‑grade GPU. It combines a lightweight front‑end for low‑latency tracking with a hierarchical backend that enforces local, mid‑level, and global consistency, avoiding bundle adjustment and thus handling dynamic scenes naturally. The system also supports stereo, RGB‑D, and LiDAR inputs, achieving strong camera tracking performance and reducing absolute trajectory error by over 70% on several datasets, with sub‑meter accuracy when LiDAR is added.

By Hengyi Wang, Lourdes Agapito
arXiv AI
Sep 17

Visual Perception Engine: Fast and Flexible Multi-Head Inference for Robotic Vision Tasks

Visual Perception Engine (VPEngine) is a modular framework that enables efficient GPU usage for robotic vision tasks by sharing a foundation model backbone across multiple specialized task heads. It eliminates redundant feature extraction, supports dynamic task prioritization, and achieves up to 3× speedup over sequential execution. The open‑source Python implementation, with ROS2 C++ bindings, delivers real‑time performance (≥50 Hz) on NVIDIA Jetson Orin AGX using TensorRT‑optimized models.

By Jakub {\L}ucki, Jonathan Becktor, Georgios Georgakis, Rob Royce, Shehryar Khattak
arXiv Machine Learning
Aug 27

Minimalist Visual Inertial Odometry

The paper introduces a minimalist visual-inertial odometry system that uses only four downward-facing photodiodes with optical Gabor masks and an IMU to estimate motion for differential-drive robots. By jointly optimizing mask parameters and a Temporal Convolutional Network in a physically-grounded simulator, the model decodes speed from the photodiode signals and combines it with IMU angular speed to produce a continuous planar trajectory. Experiments on a prototype robot across indoor and outdoor terrains show that the system closely follows reference trajectories without real-world fine-tuning.

By Francesco Pasti, Jeremy Klotz, Nicola Bellotto, Shree K. Nayar