arXiv Computer Vision

LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes

LIVIN is a new benchmark that evaluates spatial and embodied intelligence using digital twins of 30 diverse lived‑in homes. The replicas preserve real room layouts, furniture configurations, and everyday belongings, created through a human‑in‑the‑loop workflow of instance recognition, architectural reconstruction, and object placement. Four tasks—3D detection, 3D reconstruction, navigation, and loco‑manipulation—demonstrate that current methods struggle with dense object arrangements, occlusions, limited free space, and constrained interaction regions typical of realistic homes.

Hugging Face Trending Papers
Aug 19

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

The paper introduces RoomWright, a code‑driven framework that generates 3D indoor scenes for embodied AI by focusing on functional usage rather than just visual layout. It performs usage‑driven object reasoning, treating anchors as task centers to select task‑required objects and their affordances, and compiles interactions into trigger‑condition‑effect rules that update object states. The system also addresses ambiguous object orientation through annotation‑guided usage cues, producing scenes that are executable, editable, and ready for simulation‑based policy learning.

arXiv AI
5d ago

Articulated 3D Scene Graphs for Open-World Mobile Manipulation

The paper introduces MoMa-SG, a framework that constructs semantic‑kinematic 3D scene graphs for articulated scenes using RGB‑D sequences. It segments interactions, tracks points robustly, estimates joint parameters in a single optimization, and associates objects with articulations to detect contained items. The authors also present the Arti4D‑Semantic dataset with 62 real‑world sequences and demonstrate the system’s effectiveness on a quadruped and a mobile manipulator.

By Martin B\"uchner, Adrian R\"ofer, Tim Engelbracht, Tim Welschehold, Zuria Bauer, Hermann Blum, Marc Pollefeys, Abhinav Valada
arXiv Computer Vision
Oct 2

LiteReality-Agent: An Agentic System for Interactable 3D Indoor Scene Reconstruction

LiteReality-Agent is an agentic system that reconstructs real indoor environments into realistic, articulated, and simulation-ready 3D scenes from RGB‑D scans. It treats reconstruction as a coding problem, where a coding agent iteratively edits a Python script (Room.py) using specialized tools, while an observe‑edit‑verify harness ensures evidence gathering, measurement, verification, layout optimisation, simulation readiness, and quality control. The system outperforms recent models like Astra and Fable in geometric accuracy, visual realism, and simulation compatibility, and its modular framework is positioned as a robust foundation for future agent‑driven reconstruction tasks.

By Zhening Huang, Yueyan Li, Johnathan Chiu, Xiaoyang Lyu, Matt Zhou, Yuxin Yao, Joan Lasenby, Shangzhe Wu