arXiv AI

Adaptive Companionship for Group-Following Robots: Handling Dynamically Changing Group Formations

arXiv:2607. 01287v1 Announce Type: cross Abstract: Accompanying a group of humans is an essential aspect of developing human-like social cognition in robots.

arXiv AI
Sep 24

Where Should I Join? Robot Group Joining via Language-Guided Goal Prediction

The paper introduces a language‑guided approach for robots to join human groups by predicting socially compliant joining poses. It uses recursive spectral partitioning to generate candidate group subsets, ranks them with a language‑conditioned image–geometry model, and then applies a goal predictor that incorporates human‑formation priors to produce a multimodal energy–orientation map of feasible robot poses. Experiments on various group scenarios show competitive grounding accuracy, superior joining‑pose prediction, and successful real‑robot demonstrations in both static and dynamic settings.

By Zilin Fang, Zishuo Wang, Gim Hee Lee, David Hsu
arXiv Machine Learning
3d ago

STARS: From Spatiotemporal Dynamics to Social Representations in Human-Robot Interaction

arXiv:2609.40245v2 Announce Type: cross Abstract: Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-...

By Nathan Tsoi, Michael J. Munje, Tejas Oberoi, Rishab Maheshwari, Pengen Zheng, Tanush Chauhan, Peter Stone, Joydeep Biswas
arXiv AI
Jul 14

Think When It Matters: Conditional VLM Reasoning for Social Navigation with RL Policies

arXiv:2607. 10991v1 Announce Type: cross Abstract: As mobile robots become more integrated into everyday human environments, social robot navigation is becoming essential for ensuring human comfort, safety, and trust.

By Ali Ahmadi, Hamed Rahimi, Adrien Jacquet Cretides, Marie Samson, Mahdi Khoramshahi, Mohamed Chetouani
arXiv AI
Jun 9

HA-VLN 2.0: An Open Benchmark and Leaderboard for Human-Aware Navigation in Discrete and Continuous Environments with Dynamic Multi-Human Interactions

arXiv:2503. 14229v4 Announce Type: replace Abstract: Vision-and-Language Navigation (VLN) has been studied mainly in either discrete or continuous spaces, with little attention to dynamic, crowded environments.

By Yifei Dong, Fengyi Wu, Qi He, Lingdong Kong, Heng Li, Minghan Li, Zebang Cheng, Yuxuan Zhou, Jingdong Sun, Qi Dai, Alexander G Hauptmann, Zhi-Qi Cheng
arXiv AI
4d ago

ChronoGraph: Functional 4D Scene Graphs with Vision-Language Models for Interaction Understanding and Grounded Planning

arXiv:2609.39665v1 Announce Type: new Abstract: Embodied agents must determine where to act, anticipate the resulting scene changes, and interpret observed outcomes to guide subsequent actions. This...

By Chenyangguang Zhang, Malgorzata Gwiazda, Guanlong Jiao, Yuanchen Ju, Federico Tombari, Koushil Sreenath, Marc Pollefeys, Sunghwan Hong
arXiv Computer Vision
Sep 3

Robotic Contextual Awareness for Human-Robot Collaboration and Environmental Understanding

The thesis "Robotic Contextual Awareness for Human-Robot Collaboration and Environmental Understanding" addresses the challenge of enabling autonomous mobile robots to operate safely in dynamic, human-centric environments by developing advanced contextual awareness. It presents two complementary research directions: (1) a human re-identification and tracking system that allows a robot to recognize and collaborate with a specific person while ignoring others, and (2) enhanced perceptual capabilities that provide geometric and semantic understanding of the environment for improved motion planning and interaction. These contributions aim to improve robots’ knowledge of their surroundings, facilitating smoother and more natural collaboration with humans.

By Federico Rollo