arXiv Computer Vision By Peijun Xu, Chuansen Nie, Yiyang He, Yinuo Bai, Jingyang Liu, Kuixiang Shao, Yuyang Jiao, Kuanhao Xia, Jiayi Zhu, Zitian Yang, Yanqi Zhang, Tianye Tan, Shuwei Di, Junyi Xu, Jingyi Yu, Jiayuan Gu

LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes

Read the original on arXiv Computer Vision →

LIVIN is a new benchmark that evaluates spatial and embodied intelligence using digital twins of 30 diverse lived‑in homes. The replicas preserve real room layouts, furniture configurations, and everyday belongings, created through a human‑in‑the‑loop workflow of instance recognition, architectural reconstruction, and object placement. Four tasks—3D detection, 3D reconstruction, navigation, and loco‑manipulation—demonstrate that current methods struggle with dense object arrangements, occlusions, limited free space, and constrained interaction regions typical of realistic homes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Hugging Face Trending Papers
Aug 19

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

The paper introduces RoomWright, a code‑driven framework that generates 3D indoor scenes for embodied AI by focusing on functional usage rather than just visual layout. It performs usage‑driven object reasoning, treating anchors as task centers to select task‑required objects and their affordances, and compiles interactions into trigger‑condition‑effect rules that update object states. The system also addresses ambiguous object orientation through annotation‑guided usage cues, producing scenes that are executable, editable, and ready for simulation‑based policy learning.