arXiv AI

Knowledge-Guided Vision-Language Inference for Image-Based Urban Flood Depth Estimation

The paper introduces FloodVision, a knowledge-guided vision‑language framework that estimates urban flood depth from a single RGB image. It combines a general‑purpose vision‑language model with FloodKG, a domain knowledge base that encodes canonical object dimensions and component landmarks to promote component‑level reasoning. On 654 crowdsourced New York flood images, FloodVision cuts mean absolute error from 15.62 cm to 8.75 cm and median error from 14.35 cm to 7.75 cm, outperforming the VLM‑only baseline in 69.3 % of cases.

arXiv Computer Vision
Oct 19

FloodVLM-Pix: Language-Guided Pixel-Level Flood Understanding

FloodVLM-Pix is a new language‑guided pixel‑level flood understanding model introduced in the arXiv paper "FloodVLM-Pix: Language‑Guided Pixel‑Level Flood Understanding." The authors created the first large‑scale remote sensing flood multi‑modal benchmark, comprising 131,200 image patches and 443,100 textual descriptions of flood severity and evolution. FloodVLM‑Pix incorporates a flood prior module to mitigate attentional bias and a multi‑temporal flood pixel decoder with a general‑specific feature fusion mechanism to improve flood segmentation accuracy. "whyItMatters":"The paper presents a benchmark and model that enhance both flood description quality and pixel‑level segmentation, addressing shortcomings of existing vision‑language models on flood‑related tasks."

By Chengyang Zhang, Zhihao Wang, Zhiyu Long, Xueqian Wang, Quanming Yao, Wei Wu, Gang Li
Hugging Face Trending Papers
Jun 4

Learning Geometric Representations from Videos for Spatial Intelligent Multimodal Large Language Models

Multimodal Large Language Models (MLLMs) excel at 2D semantic understanding but lack intrinsic 3D awareness, resulting in representations that fail to maintain geometric and spatial consistency across video frames. Given the scarcity of large-scale 3D data, we present GeoVR, a novel framework that learns geometric representations using purely 2D video sequences.

arXiv Computer Vision
Sep 18

CitySTAR: Structured and Topology-Aware Reasoning for Open-Vocabulary Urban 3D Grounding

CitySTAR introduces a training‑free framework that transforms billion‑scale urban point clouds into a query‑ready scene graph of open‑vocabulary 3D instances, using CodeLLM‑driven tools to supply multimodal evidence for node attributes and spatial relations. It models target‑context topology with paired hypergraphs and performs bidirectional topology verification for structural disambiguation, followed by a Reflective Cross‑modal Grounding module that integrates topology consistency and 2D visual evidence to decide over a metric‑aware 3D context graph. The authors also present CitySTAR‑3D, a benchmark that enhances semantic coverage, instance completeness, bounding‑box fidelity, and spatial‑relation complexity for city‑scale 3D grounding, and report extensive experiments showing consistent improvements in open‑world urban 3D grounding with strong interpretability and generalization.

By Shuai Zhang, Hongye Hou, Qinghe Liu, Zhuoxiao Li, Dongli Wu, Jing Ou, Yuan Liu, Wufan Zhao
arXiv AI
Aug 18

FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edge

arXiv:2608. 15410v1 Announce Type: cross Abstract: Reasoning segmentation enables vision-language models (VLMs) to translate mission-relevant language requests into pixel-level visual grounding, offering a natural perception interface for embodied agents.

By Rajat Bhattacharjya, Yoomee Jung, Minwoo Kim, Sing-Yao Wu, Eli Bozorgzadeh, Nalini Venkatasubramanian, Nikil Dutt
arXiv AI
Sep 10

MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling

MV-STRIDE is a Multi‑View hierarchical Spatial Reasoning dataset that models dependencies among perception, scene understanding, and contextual reasoning to support 3D spatial cognition. It introduces a QA generation pipeline that enforces cross‑view constraints, producing multi‑level reasoning tasks with chain‑of‑thought supervision. Experiments show that training on MV‑STRIDE yields state‑of‑the‑art performance on multi‑view spatial benchmarks, enabling MLLMs to reason robustly across diverse viewpoints.

By Jin Xu, Xiaojian Huang, Zhuodong Luo, Zhihong Zhang, Xin Liu, Jiansheng Wei, Xinzhi Wang, Jie Zhao, Xuejin Chen
arXiv Machine Learning
Aug 11

Mechanistic Interpretability-Guided Selective Fine-Tuning of Vision-Language Models for Centimeter-Level Flood Depth Estimation

arXiv:2608. 07562v1 Announce Type: cross Abstract: Urban flooding poses an escalating threat to transportation infrastructure, yet no operational system provides real-time, street-level flood-depth estimates at centimeter resolution.

By Nafis Fuad, Xiaodong Qian, Dongxiao Zhu