arXiv Machine Learning
Oct 16

BD-HazardVLM: Probing Vision-Language Models for Latent Defensive-Driving Hazards in Bangladesh Road Scenes

BD-HazardVLM is a diagnostic benchmark of 500 Bangladesh road-scene images designed to probe vision‑language models’ defensive‑driving reasoning in weakly structured Global South traffic. The benchmark includes annotations for hazard presence, category, risk timing, severity, defensive actions, visible evidence, and bias traps, and evaluates models such as Qwen2.5‑VL‑7B, InternVL3‑8B, and MiniCPM‑V‑4.6. Results show high binary hazard‑presence accuracy but poor fine‑grained reasoning, with category accuracy below 40 %, risk‑timing accuracy under 13 %, and defensive‑action matching under 2 %. whyItMatters":"The study demonstrates that coarse hazard recognition does not guarantee reliable fine‑grained defensive‑driving reasoning, highlighting the need for geographically diverse safety evaluation of vision‑language models."

By Abdullah Al Maruf, Md. Sajedul Islam, Tanmoy Mridha, Irfan Hossain Bhuiyan
arXiv AI
Oct 16

Counterfactual Neighborhood Risk Fields: Evidence-Grounded Selective Safety for Vision-Language Models

The paper introduces Counterfactual Neighborhood Risk Fields (CNRF), an evidence‑grounded framework that improves safety for vision‑language models (VLMs). CNRF builds context‑matched benign‑harmful counterfactual pairs, uses their representation differences to define risk directions, and separates neighborhood support from risk estimation. This approach allows selective intervention rather than blanket rejection, achieving high macro defense success rates across multiple VLMs while preserving benign‑task utility.

By Tianshi Wang, Jingsong Wang, Fengling Li, Jingjing Li, Xin Li, Lei Zhu