Computer vision

Detection, segmentation, depth and recognition research, plus the vision backbones that keep displacing the last generation.

3,379 stories · RSS feed

arXiv Computer Vision
Sep 16

NeuroSymbEAD: A Large Scale Neuro-Symbolic Caption Dataset for Omni-Directional Embodied Autonomous Driving

NeuroSymbEAD is a large‑scale neuro‑symbolic caption dataset that builds an ego‑centric knowledge graph of static and dynamic objects on the KITTI‑360 dataset, annotating classes, categories, heading directions, orientations, and distances from the ego‑vehicle. The dataset generates multilevel textual captions that serve as a lightweight representation of an ego‑centric scene map, enabling outdoor scene‑map reconstruction, visual recognition, and object grounding. Baselines for driving common sense and traffic/scene understanding are established, and the dataset is benchmarked using pre‑trained grounding and learned auto‑regressive captioning networks to support vision‑language and foundation models for traffic‑scene explanation, 3D reasoning, and interpretable autonomous‑driving perception.

By Muhammad Ahmed Ullah Khan, Mohammed Elamine, Sheikh Talha Uddin, Didier Stricker, Sk Aziz Ali, Muhammad Zeshan Afzal
arXiv Computer Vision
Sep 16

Temporally Consistent Graph Extraction and Matching for Longitudinal Angiographic Images

The paper introduces a method for extracting and matching vessel graphs from longitudinal angiographic images that improves temporal consistency. By performing an early matching step before refining the graphs—removing spurious bulges and merging junctions using joint information—the approach yields a higher matched area and reduces graph fragmentation compared to traditional separate or no refinement strategies. Experiments on complex retinal vessel graphs confirm these benefits.

By Linus Kreitner, Laurin Lux, Carmen Baumann, Daniel Rueckert, Martin J. Menten
arXiv AI
Sep 16

When majority rules, minority loses: bias amplification of gradient descent

The paper presents a formal framework for majority‑minority learning tasks, demonstrating that standard gradient‑descent training can amplify bias by favoring majority groups and producing stereotypical predictors that ignore minority‑specific features. It identifies three key theoretical findings: the close proximity between full‑data and stereotypical predictors, the dominance of a region where training the entire model mainly captures majority traits, and a lower bound on the extra training needed to mitigate this effect. Experiments on deep learning for tabular and image classification illustrate these results.

By Fran\c{c}ois Bachoc (LPP), J\'er\^ome Bolte (TSE-R), Ryan Boustany (TSE-R), Jean-Michel Loubes (IMT, REGALIA)
arXiv Computer Vision
Sep 16

Racing in Volume with Flow Ensembles

The paper introduces FastFlowGS, a streaming 4D Gaussian Splatting method that reconstructs fast-moving subjects from a sparse set of external cameras, and Monaco4D, a photorealistic Unreal Engine 5 benchmark featuring Formula 1 sequences with dense ground truth. FastFlowGS combines sparse matches, semi-dense tracks, and dense optical flow using a Kalman-style temporal update, achieving significant performance gains over existing baselines on both CMU-Panoptic and Monaco4D datasets. The benchmark provides varied illumination and viewpoints from trackside, onboard, and drone cameras, enabling evaluation of high-speed outdoor reconstruction.

By Saswat Subhajyoti Mallick, Riu Cherdchusakulchai, Marc Ruiz Olle, Albert Mosella-Montoro, Jose Ribeiro-Gomes, Francisco Vicente Carrasco, Fernando De la Torre
arXiv Computer Vision
Sep 16

Optical-Flow Wingbeat Counting in MuJoCo: A Comparison of Convolutional, Spiking, and Attention-Based Temporal Models

The paper evaluates optical‑flow based wingbeat counting on simulated Crazyflie vehicles using MuJoCo. Three temporal models—causal temporal convolution, leaky integrate‑and‑fire spiking, and causal self‑attention—were combined with a shared convolutional encoder and tested on 1,440 clips at 1.5 m and 3.0 m distances. Exact‑count accuracies ranged from 92.22 % to 96.67 %, with no significant differences between models, and the study highlights the need to report both total counts and event‑level timing.

By Zhang Nengbo
arXiv Machine Learning
Sep 16

From Foundation Embeddings to Cropland Maps: Label Efficiency, Temporal Transferability and Independent Human Validation

The study evaluates the use of frozen geospatial foundation embeddings (AlphaEarth) for mapping cultivated versus non‑cultivated land in Maine. Using 192 spatially separated patches and USDA Cropland Data Layer labels, a lightweight classifier achieved 93.7% overall accuracy without fine‑tuning, and a nearest‑class‑centroid rule reached 90.2%. A balanced sample of 60,000 labeled pixels was nearly as effective as the full 8.6 million‑pixel pool, and classifiers trained in one year remained accurate across 2018‑2023. In a blind human validation of 385 points, the AlphaEarth‑plus‑random‑forest map matched 95.3% of the consensus, outperforming the CDL reference (91.7%).

By Mohammad Ammar Mughees, Giovanni Montefoschi, Zhongxin Chen, Maria Antonia Brovelli