arXiv AI

GT-Space: Enhancing Heterogeneous Collaborative Perception with Ground Truth Feature Space

arXiv Machine Learning
Jul 28

SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception

arXiv:2607. 23910v1 Announce Type: cross Abstract: Cooperative perception through vehicle-to-everything (V2X) communication can overcome the inherent physical limitations of individual autonomous vehicles, such as occlusions and limited sensor range.

By Goodarz Mehr, Sepideh Gohari, Montasir Abbas, Azim Eskandarian
arXiv Computer Vision
Sep 11

HeteroPROMPT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework

HeteroPROMPT is a real‑time, privacy‑preserving framework for heterogeneous collaborative perception in autonomous systems. It aligns features from diverse sensors and models into a unified ego‑centric space using modular prompts and lightweight tuning, while keeping encoders and fusion stacks frozen. The system employs a metadata‑free autoencoder for modality classification and routing, achieving higher average precision on OPV2V‑H and V2XSet datasets with far fewer trainable parameters.

By Armin Maleki, Hayder Radha
arXiv Computer Vision
Sep 3

BOLT: Online Lightweight Adaptation for Preparation-Free Heterogeneous Cooperative Perception

BOLT is a lightweight plug‑and‑play module that enables preparation‑free heterogeneous cooperative perception by adapting neighboring features online through ego‑as‑teacher distillation. It requires only ego predictions, no ground‑truth labels, and uses high‑confidence ego features to align cross‑agent feature domains while allowing neighbors to contribute in low‑confidence regions. With just 0.9 M trainable parameters, BOLT boosts AP@50 by up to 32.3 points over unadapted fusion and consistently outperforms ego‑only results on DAIR‑V2X and OPV2V.

By Kang Yang, Tianci Bu, Peng Wang, Deying Li, Yongcai Wang
arXiv AI
Sep 4

CauseCollab: Causal Unified and Modality-Agnostic Network for Heterogeneous Collaborative Perception

CauseCollab is a causal unified and modality‑agnostic network designed to improve collaborative perception across heterogeneous sensor modalities. It disentangles semantic factors from modality‑specific confounders using causal metric learning and employs a context‑guided Unified Converter to maintain cross‑modal semantic consistency. The approach requires only minimal adapter training when adding new modalities and achieves state‑of‑the‑art results on the OPV2V and DAIR‑V2X datasets, especially in scenarios with large modality gaps.

By Weize Li, Yang Li, Quan Yuan, Xiaoyuan Fu, Guiyang Luo, Jinglin Li
Hugging Face Trending Papers
Aug 10

Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives

Connected Autonomous Vehicles (CAVs) increasingly exploit Vehicle-to-Everything (V2X) communication to exchange multi-source sensor information, enabling advanced Collaborative Perception (CP) capabilities. Extending beyond these capabilities, this work focuses on Collaborative Joint Perception and Prediction (Co-P&P), a paradigm that unifies CP with motion prediction to mitigate two persistent challenges: the accumulation of perception errors and visual occlusions.