arXiv AI

Revitalizing Public Urban Places through Cultural and Political Memory: A Technological Approach with LLMs and Augmented Reality

arXiv:2607. 22613v1 Announce Type: cross Abstract: This paper explores the intersection of memory, place, and identity, examining how new technologies, particularly Apple Vision Pro, can illuminate this nexus.

arXiv Computer Vision
Sep 15

Integrating Multi-view Multi-light Surface Reconstruction into Cultural Heritage Workflows

arXiv:2609.15833v1 Announce Type: new Abstract: Cultural heritage documentation increasingly relies on image-based 3D surface reconstruction, with photogrammetry software making such workflows access...

By Baptiste Brument, Robin Bruneau, Benjamin Coupry, Vincent Demoulin, Jean M\'elou, Antoine Laurent, Fabien Castan, Jean-Denis Durou, Lilian Calvet
arXiv AI
Sep 16

Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM

The paper presents a multimodal machine learning framework that classifies Emirati residential architectural styles by combining visual features from images and textual descriptions using OpenAI's CLIP model. The unified 512‑dimensional embeddings are reduced with UMAP, clustered with K‑Means, and then used to train an SVM classifier, achieving a 98% accuracy across eight style clusters. This approach outperforms previous studies and demonstrates the value of integrating visual and textual data for cultural heritage analysis.

By Ahmed Ammar Kubba, Manar Abu Talib, Iman Ibrahim, Qassim Nasir
arXiv Computer Vision
Sep 2

You Cannot Photograph the Same Street Twice: Reliability Limits in Vision-Language Measurement of Urban Change

Vision‑language models used to gauge urban change from repeated street‑level images exhibit limited reliability at single locations. In a study of 4,648 image pairs from 435 Google Street View points across five U.S. cities, re‑photographing the same street altered perception scores by an average of 0.80 points—about two‑thirds of the difference between distinct streets—while repeated model calls added negligible variation. Although image re‑encoding, prompt order, and various image statistics contributed modestly, a small systematic drift (~0.1 points) persisted and grew with time between captures, suggesting minor unrecorded physical changes. Controlled experiments revealed that varying camera and image properties can shift scores, and that camera geometry alone caused a model to falsely report change in 45% of identical scenes; normalising to a common virtual camera reduced this to 7.5%. Despite these individual‑point unreliabilities, aggregating many paired observations recovers a clear redevelopment signal, indicating that such models are dependable at large scales but not for single‑location assessments.

By Kaizhen Tan
arXiv AI
Aug 26

PlaceSeek: Human-Centered Geospatial Retrieval of Urban Outdoor Places via Semantic Grounding and Affective Alignment

PlaceSeek is a human‑centered geospatial retrieval framework that maps natural‑language queries to street‑view images by decomposing queries into functional and affective sub‑intents. It uses a Semantic Grounding Module to verify that candidate images contain the physical evidence needed for the intended activity, and an Affective Alignment Module to re‑rank these candidates based on human urban perception judgments. Evaluated on 31,956 Milan street‑view locations, PlaceSeek achieves high precision and ranking metrics, outperforming several vision‑language baselines and demonstrating the importance of both physical grounding and affective alignment for complex urban spatial queries.

By Ziqi Cui, Shangyu Lou
arXiv AI
Jun 6

Using street view images and visual LLMs to predict heritage values for governance support: Risks, ethics, and policy implications

arXiv:2601. 06056v2 Announce Type: replace-cross Abstract: During 2025 and 2026, the Energy Performance of Buildings Directive is being implemented in the European Union member states, requiring all member states to have National Building Renovation Plans.

By Tim Johansson, Mikael Mangold, Kristina Dabrock, Anna Donarelli, Ingrid Campo-Ruiz
Hugging Face Trending Papers
Jun 8

ChinaHeritaQA: A Culturally-Grounded Visual Question Answering Dataset for World Heritage Sites in China

We introduce ChinaHeritaQA, a multimodal benchmark dataset for evaluating the cultural reasoning abilities of vision-language models (VLMs) on UNESCO World Heritage sites in China. The dataset comprises 2,279 in-the-wild images paired with 14,133 bilingual (Chinese/English) multiple-choice QA pairs spanning seven cognitive dimensions, from basic identity recognition to historical periodization and architectural analysis.

arXiv Computer Vision
Sep 10

The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library

The Living Library is an end‑to‑end framework that converts fragmented digital archives into governed, conversational exhibit experiences. Developed at the Theodore Roosevelt Presidential Library, it digitizes a 300,000‑record collection, enriches it with OCR and metadata, and publishes it to a hybrid dense/semantic index. The system supports curator review via the Archivist App, powers a researcher interface, and runs Talk to TR—a museum exhibit where a digital human embodiment of Theodore Roosevelt answers visitors’ questions using Cross‑Era Analogical Grounding and dual‑path retrieval to keep responses grounded and responsive.

By Pengce Wang, Lucia Ronchi Darre, Matt Briney, Michaell Bakalars, Dan Rutkowski, Ursula Hardy, David Wolf, Laura Hoffman, Allen Kim, Shawn Wright, Juan Lavista Ferres