arXiv Computer Vision
ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perception
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Jun 11
TouchThinker: Scaling Tactile Commonsense Reasoning to the Open World with Large-scale Data and Action-aware Representation
arXiv:2606. 11637v1 Announce Type: new Abstract: Touch is a key modality for embodied agents to understand the physical world.
arXiv Machine Learning
Jun 5
What Objects Enable, Not What They Are: Functional Latent Spaces for Affordance Reasoning
arXiv:2606. 05533v1 Announce Type: new Abstract: Existing robot planning systems rely on appearance-based reasoning, where visual observations are encoded into latent spaces organized around object appearances (e.
Hugging Face Trending Papers
Jul 14
Hy-Embodied-VLM-1.0: Efficient Physical-World Agents
Building capable embodied agents requires not only multimodal perception and understanding, but also agentic capabilities for reasoning about actions, adapting to evolving situations, and interacting with the physical world. In this report, we introduce Hy-Embodied-VLM-1.
arXiv Computer Vision
Sep 22
Cognitive Action Reasoning for Proactive Robots from Human-Centered Multimodal Observations
The paper introduces ProAction, a multimodal dataset of 10,000 samples comprising visual, audio, and text inputs across 12 daily-life scenarios, designed to support the Proactive Robot Action Reasoning (ProRobo) problem. It presents a two-stage human-in-the-loop annotation pipeline that incorporates appraisal and Theory-of-Mind considerations to generate cognitively grounded high-level action labels. The authors benchmark multimodal large language models and propose MMC2Act, showing that training on ProAction significantly improves proactive action reasoning compared to general-purpose models.
arXiv Machine Learning
Sep 22
$N_0$-Foundation: Towards the Age of Tactile Intelligence
arXiv:2608.29601v2 Announce Type: replace-cross Abstract: We present $N_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale mul...
arXiv AI
Jul 7
TacReasoner: A Dynamic Tactile-Language Framework for Interactive Reasoning in Real-World Scenarios
arXiv:2607. 05131v1 Announce Type: new Abstract: Among the five primary human senses, tactile is arguably the most fundamental to survival, as it enables the perception of physical contact and interaction in real-world environments.