arXiv Machine Learning
Jun 3

WildRoadBench: A Wild Aerial Road-Damage Grounding Benchmark for Vision-Language Models and Autonomous Agents

arXiv:2605. 20306v2 Announce Type: replace-cross Abstract: We introduce WildRoadBench, a wild aerial road-damage grounding benchmark that couples direct visual grounding by vision-language models with autonomous research-and-engineering by LLM-driven agents on a single professionally annotated UAV corpus.

By Bingnan Liu, Chenhang Cui, Rui Huang, Jiani Luo, Zhirong Shen, Tinghao Wang, Xiande Huang, Lingbei Meng, Fei Shen, An Zhang
arXiv Computer Vision
Aug 31

SDGBiasBench: Benchmarking and Mitigating Vision--Language Models' Biases in Sustainable Development Goals

SDGBiasBench is a large-scale benchmark suite designed to evaluate and mitigate biases in vision–language models (VLMs) when reasoning about Sustainable Development Goals (SDGs). It contains 500k expert‑involved multiple‑choice questions and 50k regression tasks, allowing assessment of both decision‑level and estimation‑level bias. Experiments show that current VLMs exhibit intrinsic SDG bias, often relying on priors rather than multimodal evidence, and the proposed CADE method significantly reduces this bias, improving accuracy and reducing mean absolute error.

By Zihang Lin, Huaiyuan Qin, Muli Yang, Hongyuan Zhu