arXiv Computer Vision

Stereo LWIR-RGB Automatic Labeling for Low-Light Camera-Based VRU Detection

The paper introduces an automated pipeline for labeling vulnerable road users (VRUs) in low-light conditions using stereo LWIR-RGB image pairs. By sourcing labels from LWIR data, which highlights VRUs through body temperature, the method reduces hardware complexity compared to previous setups. Experiments on a Finnish dataset show that models trained on these auto-generated labels outperform off-the-shelf baselines and hand-labeled fine-tuned models on several metrics.

arXiv Computer Vision
Sep 7

E-RGB-D: Real-Time Event-Based Perception with Structured Light

The paper introduces E‑RGB‑D, a real‑time event‑based perception system that combines a Digital Light Processing projector with a monochrome event camera to produce RGB‑D data. By projecting structured light and capturing asynchronous brightness changes, the system can detect color and depth for each pixel, achieving a color detection speed of 1400 fps and a depth detection rate of 4 kHz. The approach enables frameless RGB‑D sensing and delivers colorful point clouds without compromising spatial resolution.

By Seyed Ehsan Marjani Bajestani, Giovanni Beltrame
Hugging Face Trending Papers
5d ago

3L-D: A Low-Light Level Dataset from a Sensor-Agnostic, Alignment-Preserving Acquisition Framework

The paper introduces 3L-Dataset, a physically calibrated low‑light image and video dataset created with a modular, sensor‑agnostic acquisition framework. The test bench reproduces the Midavaine night‑level scale from full moon to overcast moonless night, covering visible to near‑infrared spectra across varied environments while ensuring sub‑pixel alignment across synchronized image sextuplets. The authors evaluate deep‑learning baselines on this dataset, highlighting trade‑offs between reconstruction fidelity, perceptual quality, and inference latency under severe photon starvation.

arXiv Computer Vision
Oct 9

A Camera-Native Stereo VR180 Dataset

The paper introduces a new stereo VR180 dataset captured directly with Blackmagic URSA Cine Immersive cameras, comprising 1,211 samples (636 video clips and 575 stills). Each sample is provided in camera-native Blackmagic RAW, separate-eye fisheye HEVC, and half-equirectangular HEVC formats, along with factory lens calibration and conversion tools. The authors also demonstrate that native-fisheye coding requires significantly more bitrate than half-equirectangular coding for equivalent viewport quality across all tested clips.

By Linxuan Lu
arXiv AI
Aug 19

Training with synthetic data for drone detection in thermal imagery

The paper explores a synthetic-first training approach for detecting drones in medium- and long-wave infrared imagery, combining synthetic scene generation with fine-tuning on real data. It demonstrates that synthetic data can establish initial object representations, but real infrared data is crucial to close domain gaps and improve reliability. The study finds that aligning datasets has a greater impact on performance than increasing model size, and that semantic alignment in feature space is the strongest predictor of success, with radiometric factors like entropy and dynamic range also contributing.

By Tanel Liiv, Sander Soodla, Nzamba Bignoumba, Alma M. Liezenga, Toomas Pruuden
arXiv Computer Vision
Sep 23

Real-World Perception for Autonomous Driving in Adverse Weather: Enhancing Standard Detectors via Foundation-Guided Auto-Annotation

The paper presents a foundation-guided auto‑annotation pipeline that improves standard autonomous driving object detectors in adverse weather. By benchmarking YOLOv8, Co‑DETR, and SAM3 on a custom dataset of 25 operational scenarios, the authors find SAM3 to be the most robust and use it offline to generate pseudo‑labels. Fine‑tuning YOLOv8 on these labels boosts overall mAP by 16.04% and yields significant gains in specific conditions such as Residential Direct Sunlight (32.73%) and Highway Fog (28.65%).

By Sepideh Gohari, Goodarz Mehr, Azim Eskandarian
arXiv AI
Sep 1

Making the Discrete Continuous: Synthetic RAW Augmentations for Fine-Grained Evaluation of Person Detection Performance in Low Light

arXiv:2605.22455v2 Announce Type: replace-cross Abstract: Real-world deployment of AI vision models is both fueled and limited by the data available for training and testing. Real datasets are sparse...

By Valeria Pais, Malena Mendilaharzu, Daniele Faccio, Luis Oala, Christoph Clausen, Bruno Sanguinetti
arXiv Computer Vision
Oct 16

VesperMUSE: Multi-Modal Fusion Vision Transformer for Image Semantic Segmentation Under Diverse Light Conditions

VesperMUSE is a multi‑modal vision transformer that enhances image semantic segmentation under varied lighting by combining physics‑informed low‑light adaptation, thermal‑guided low‑light image enhancement, and surface normal maps. The framework fuses RGB, thermal, and normal features through a modality‑agnostic self‑attention mechanism, enabling robust segmentation without architectural changes for different sensor setups. Extensive tests show that VesperMUSE recovers missing visual cues and achieves state‑of‑the‑art performance in extreme, unstructured environments.

By Raul Balmez