arXiv Computer Vision By Federico Rollo

Robotic Contextual Awareness for Human-Robot Collaboration and Environmental Understanding

Read the original on arXiv Computer Vision →

The thesis "Robotic Contextual Awareness for Human-Robot Collaboration and Environmental Understanding" addresses the challenge of enabling autonomous mobile robots to operate safely in dynamic, human-centric environments by developing advanced contextual awareness. It presents two complementary research directions: (1) a human re-identification and tracking system that allows a robot to recognize and collaborate with a specific person while ignoring others, and (2) enhanced perceptual capabilities that provide geometric and semantic understanding of the environment for improved motion planning and interaction. These contributions aim to improve robots’ knowledge of their surroundings, facilitating smoother and more natural collaboration with humans.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 17

HINT-Plan: Human Intention-Aware Robot Task Planning in Context-Rich Environments using Vision Language Models

HINT-Plan is a new method that integrates human intention prediction into robot task planning by using Vision Language Models to infer high‑level human intentions from third‑person images. These intentions are converted into goal states and combined with hierarchical Scene Graphs to formulate joint task‑planning problems in context‑rich environments. In a photorealistic simulation, HINT-Plan achieved a 69.71% success rate, outperforming baselines by up to 35.29% and reducing functional conflicts.

By Yuchen Liu, Luigi Palmieri, Lujun Li, Radu State, Ilche Georgievski, Marco Aiello