arXiv Computer Vision September 25, 2026 By Liu Liu, Andres Sevtsuk

A Vision-Language Framework for Measuring Social Life on Sidewalks

Read the original on arXiv Computer Vision →

The paper introduces a vision‑language framework that extracts social indicators from street‑level imagery, converting panoramic views into sidewalk‑facing sideviews with timestamps. Using a VLM‑based activity detection system, it codes each pedestrian across ten observable dimensions, producing a Social Dwelling Index (SDI) that captures grouping, dwelling, activity diversity, and accessibility flags. Applied to over 100,000 sideviews in New York City, the study finds that pedestrian volume and SDI are only weakly correlated, indicating that high foot traffic does not necessarily equate to intense social activity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning

Aug 21

From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City

arXiv:2608. 20026v1 Announce Type: cross Abstract: Streetscape quality has become a central concern in contemporary urban planning, particularly within the framework of the pedestrian-friendly 15-minute city, where walkability and public-space quality are increasingly recognized as key determinants of urban performance.

By Joan Perez, Giovanni Fusco

llms multimodal

arXiv AI

Sep 1

Multimodal Large Language Models Predict Urban Safety Perception but Encode Non-Neutral Demographic Priors

arXiv:2503.00610v2 Announce Type: replace-cross Abstract: Understanding how people perceive urban environments is essential for inclusive planning, yet conventional surveys are costly and difficult t...

By Ciro Beneduce, Bruno Lepri, Massimiliano Luca

llms multimodal safety

arXiv AI

Jun 16

UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics

arXiv:2606. 15890v1 Announce Type: new Abstract: Understanding urban wellbeing from multimodal data requires integrating heterogeneous spatial and temporal signals, posing significant challenges for current multimodal large language models (MLLMs).

By Yanxin Xi, Xiang Su, Jie Feng, Yu Liu, Sasu Tarkoma, Pan Hui

llms multimodal benchmarks safety

arXiv Machine Learning

Aug 10

Walkable to Whom? Capturing Subjective Variability in Walkability Perception Using Multimodal Deep Learning

arXiv:2608. 06934v1 Announce Type: new Abstract: Visual perception of walkability varies substantially across individuals, reflecting differences in personal characteristics, experiences, and preferences.

By Moloud Damandeh, Meead Saberi

multimodal

arXiv Computer Vision

Aug 31

iOSPointMapper: RealTime Pedestrian and Accessibility Mapping with Mobile AI

iOSPointMapper is a mobile app that performs real‑time, privacy‑conscious sidewalk mapping using on‑device semantic segmentation, LiDAR depth estimation, and fused GPS/IMU data on recent iPhones and iPads. It detects and localizes sidewalk‑relevant features such as traffic signs, traffic lights, and poles, and includes a user‑guided annotation interface for validating outputs before submission. The anonymized data is transmitted to the Transportation Data Exchange Initiative (TDEI), where it integrates with broader multimodal transportation datasets, and evaluations show the app’s potential for enhanced pedestrian mapping.

By Himanshu Naidu, Yuxiang Zhang, Sachin Mehta, Anat Caspi

computer-vision multimodal safety data-engineering

arXiv Machine Learning

Jul 24

Safety-oriented sidewalk and road segmentation for smartphone-based assistive navigation

arXiv:2607. 21137v1 Announce Type: cross Abstract: Independent sidewalk mobility is essential for blind and visually impaired pedestrians (BVIPs), yet smartphone-based assistive navigation requires perception models that distinguish walkable sidewalks from adjacent unsafe regions.

By Hakan Calim, Anamaria Dumitrescu, Adarsh Bhandary Panambur, Huzaifa Asif, Andreas Maier

computer-vision fine-tuning benchmarks safety

One email a morning, machine-written

Related stories

From Street View Imagery to Street Quality Indicators: Vision Language Inference for the Suburban 15-minute City

Multimodal Large Language Models Predict Urban Safety Perception but Encode Non-Neutral Demographic Priors

UrbanWell: Benchmarking Multimodal Large Language Models for Spatio-Temporal Urban Wellbeing Analytics

Walkable to Whom? Capturing Subjective Variability in Walkability Perception Using Multimodal Deep Learning

iOSPointMapper: RealTime Pedestrian and Accessibility Mapping with Mobile AI

Safety-oriented sidewalk and road segmentation for smartphone-based assistive navigation