arXiv AI

Agent-Wise Test-Time Normalization for Camera-Based Cooperative Perception with Corrupted Collaborators

The paper introduces AgentNorm, an agent‑wise test‑time normalization technique for camera‑based cooperative perception. Unlike pooled batch‑normalization, AgentNorm estimates normalization statistics separately for each collaborator and anchors the ego vehicle to its own statistics, preventing degradation when a collaborator’s cameras are corrupted by fog, motion blur, or exposure errors. Experiments on OPV2V and DAIR‑V2X‑C datasets show significant AP improvements under severe fog and motion blur, with minimal added latency.

arXiv Computer Vision
Oct 5

FRUC: Feedforward Dynamic Scene Reconstruction from Uncalibrated Collaborative Driving Views

FRUC is a feedforward 3D Gaussian Splatting framework that reconstructs dynamic scenes from uncalibrated collaborative driving views. It uses a visual‑grounded geometric Transformer backbone for one‑shot, calibration‑free inference and introduces an ego‑centric causal occlusion field to model occlusion evolution across agents. The method performs cross‑agent integration as a deterministic residual denoising process, achieving state‑of‑the‑art rendering quality and efficiency on V2X‑Real and UrbanIng‑V2X datasets.

By Yihang Tao, Yu Guo, Zhengru Fang, Haonan An, Yuguang Fang
arXiv AI
Oct 1

After a Decade: Bringing Shadow Removal into the Real World with Agentic Training Data

The paper introduces AgenticShadow, a new dataset of 17,138 image‑mask‑target triplets created through an offline agentic workflow that combines physics‑motivated generation, failure detection, feedback‑driven retry, candidate selection, and deterministic correction. This approach addresses the long‑standing lack of diverse paired shadow‑free training data by leveraging existing shadow detection datasets and producing realistic shadow‑free targets. Models trained on AgenticShadow show significant improvements, reducing color distribution differences by 50.5% and cross‑domain LAB RMSE by 19.7‑37.5% compared to prior work.

By Shilin Hu, Jingyi Xu, Dimitris Samaras, Hieu Le
arXiv Computer Vision
Sep 11

HeteroPROMPT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework

HeteroPROMPT is a real‑time, privacy‑preserving framework for heterogeneous collaborative perception in autonomous systems. It aligns features from diverse sensors and models into a unified ego‑centric space using modular prompts and lightweight tuning, while keeping encoders and fusion stacks frozen. The system employs a metadata‑free autoencoder for modality classification and routing, achieving higher average precision on OPV2V‑H and V2XSet datasets with far fewer trainable parameters.

By Armin Maleki, Hayder Radha
arXiv AI
Sep 30

Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark

arXiv:2609.37938v1 Announce Type: cross Abstract: Embodied systems must make knowledge acquired during one encounter usable in another despite changes in viewpoint, motion, and illumination. Yet aggr...

By Yuedong Tan, Lei Qi, Yu Liu, Di Wen, Ruiping Liu, Xiaoye Wang, Yufan Chen, Junwei Zheng, Chengzhi Wu, Chen Zhang, Zhihang Chen, Haiwen Sun, Zongwei Wu, Radu Timofte, Danda Pani Paudel, Kunyu Peng
arXiv AI
Sep 3

Not All Agreement Counts as Corroboration: Provenance-Conserving Multi-View Fusion for Typed Action Admission in Human-Robot Collaboration

The paper introduces PACT, a provenance‑conserving fusion method for typed action admission in human‑robot collaboration. PACT treats evidence countability as a relational variable, using a supplied provenance partition to define countable units and accumulating support only across these units. Experiments on 31,200 evaluations in 48 scene clusters show that PACT achieves a lower normalized risk‑coverage area than singleton aggregation, and in offline human‑robot collaboration it admits 47 of 57 reference‑consistent candidates without any reference‑inconsistent admissions.

By Zekai Jin, Hanrong Zhang, Yihong Tang, Fei Hu, Zhen Dong, Yi Shao
arXiv Computer Vision
Oct 2

EgoRefine: Ego-Referenced Predictive Alignment and Trajectory-Conditioned Reliability-Aware Fusion for Asynchronous Collaborative Perception

arXiv:2610.00319v1 Announce Type: new Abstract: Collaborative perception enables connected agents to share complementary observations for 3D object detection, extending sensing range and mitigating o...

By Lingzhao Kong, Yongsheng Zang, Yu Kang, Kailun Yang, Jie Fu, Yukun Zuo, Zhiyong Li
arXiv Machine Learning
Sep 24

PEARL: A Lightweight Prompt-based Feature Interpreter Framework for Real-Time, Anonymous, and Heterogeneous Collaborative Perception

PEARL is a lightweight, prompt‑embedding framework designed for real‑time, anonymous, and heterogeneous collaborative perception. It uses two parallel, low‑rank visual prompt interpreters—sparse‑detection (LWSD) and dense, domain‑invariant (LWDDI)—to align features and select the appropriate interpreter for newly joining agents without needing their configurations. Experiments on simulated and real datasets show that PEARL improves average precision by 8.2% over random selection, runs in 1.67 ms, and reduces communication cost by up to 34.7× while outperforming state‑of‑the‑art offline methods by 5.6% AP.

By Armin Maleki, Hayder Radha