arXiv Computation and Language

Robots in the City: Persona-Based Perceptions of Urban Robots

arXiv Computation and Language
Sep 25

Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation

The paper investigates how persona prompting influences the language produced by two multimodal large language models—Qwen3‑VL and Gemma4—when describing urban scenes. Outputs are categorized into descriptive grounding (captions), perception tags, and interpretive framing (justifications). Results show captions largely converge across persona profiles, while justifications differ markedly, especially along economic status, political orientation, and personality dimensions, with economic status producing the greatest variation. Perception tags also reflect attribute similarities, and exploratory topic analysis indicates persona‑specific evaluative emphasis. Overall, persona prompting has a stronger effect on interpretive framing than on descriptive grounding.

By Neemias da Silva, Matt Ratto, Myriam Delgado, Rodrigo Minetto, Daniel Silver, Thiago H Silva
Hugging Face Trending Papers
Aug 12

Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images?

Assessing proxemic danger from a robot's egocentric perspective is critical for safe embodied navigation in human environments and requires both visual and contextual reasoning. We evaluate three opensource vision-language models (VLMs) (\textit{InternVL}, \textit{Qwen-VL}, and \textit{SmolVLM}) on the classification of egocentric robot images into four danger levels, comparing three prompting strategies and two rounds of QLoRA fine-tuning against a stratified random baseline.

arXiv Computer Vision
Aug 28

UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City

UrbanGround is a sandbox that tests how well multimodal large language model agents can translate local street‑view perception into reliable action within a physically realistic replica of Hong Kong. The platform offers closed‑loop first‑person interaction and an interactive map, allowing agents to navigate the 3D city and answer spatial questions. The study evaluates agents across three research questions—scene grounding, navigation over increasing distances, and robustness to route changes—revealing that while agents excel at visual recognition and short‑range reasoning, they struggle with sustained goal‑directed behavior and pedestrian‑aware movement.

By Tianjie Ju, Zheng Wu, Yueqing Sun, Yuhan Cui, Bobo Li, Shengqiong Wu, Pengzhou Cheng, Haodong Zhao, Zongru Wu, Xinbei Ma, Doris Zhang, Kunling Li, Mong-Li Lee, Wynne Hsu, Hao Fei, Qi Gu, Gongshen Liu, Zhuosheng Zhang
arXiv AI
Jun 3

RobotValues: Evaluating Household Robots When Human Values Conflict

arXiv:2606. 03312v1 Announce Type: cross Abstract: While household robots are often evaluated based on task completion, everyday domestic environments involve value-conflicting situations in which robots are expected to choose actions that prioritize other values than task success, such as human autonomy, efficiency, or social appropriateness.

By Jongwook Han, Hyeongjin Kim, Yohan Jo
arXiv AI
Sep 2

LLM-Driven Autonomous Vehicles Inherit Human Driver Biases in Pedestrian Yielding: Results and Implications From A New Benchmark

The paper investigates how large language and visual‑language models used in autonomous vehicles inherit human driver biases when deciding whether to yield to pedestrians. It introduces two new bias‑testing methods—All Else Being Equal and Self‑Consistency tests—to evaluate these models. Results reveal that the models’ yielding decisions are influenced by pedestrian attributes such as gender, ethnicity, religion, disability, age, skin tone, and socio‑economic status, with varying patterns across models.

By Irem Yoldas, Martim Brand\~ao, Jie Zhang, Odinaldo Rodrigues
arXiv Computer Vision
Oct 16

AI Knows Where You Are: Exposure, Bias, and Inference in Multimodal Geolocation with KoreaGEO

The paper introduces KoreaGEO, a fine‑grained, multimodal, privacy‑aware benchmark for image‑based geolocation built from Korean street views. It covers four socio‑spatial clusters, nine place types, and includes two captioning styles that mimic real‑world privacy exposure. Using a three‑path protocol (image‑only, functional‑caption, high‑risk‑caption), the study shows that input modality has a stronger effect on localization accuracy and privacy risk than model size or architecture, and reveals structural prediction biases toward core cities.

By Xiaonan Wang, Bo Shao, Hansaem Kim
arXiv AI
Jul 8

Responsible Personalisation: The Double-Edged Sword of Personalisation in Human-Robot Interaction

arXiv:2607. 06344v1 Announce Type: cross Abstract: While personalisation is becoming a defining capability in human-robot interaction (HRI), the existing literature on responsible personalisation remains fragmented, offering isolated accounts of ethical risks without a structured understanding of how they emerge across interaction contexts.

By Antonio Andriella, Jauwairia Nasir, Andrea Rezzani, Alyssa Kubota, Dimitri Lacroix, Tamlin Love, Aniol Civit, Vicky Charisi, Elisabeth Andre, Wing-Yue Geoffrey Louie