Hugging Face Trending Papers

Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction

The paper introduces RoomWright, a code‑driven framework that generates 3D indoor scenes for embodied AI by focusing on functional usage rather than just visual layout. It performs usage‑driven object reasoning, treating anchors as task centers to select task‑required objects and their affordances, and compiles interactions into trigger‑condition‑effect rules that update object states. The system also addresses ambiguous object orientation through annotation‑guided usage cues, producing scenes that are executable, editable, and ready for simulation‑based policy learning.

arXiv Computer Vision
Oct 9

LIVIN: Benchmarking Spatial and Embodied Intelligence in Digital Twins of Lived-In Homes

LIVIN is a new benchmark that evaluates spatial and embodied intelligence using digital twins of 30 diverse lived‑in homes. The replicas preserve real room layouts, furniture configurations, and everyday belongings, created through a human‑in‑the‑loop workflow of instance recognition, architectural reconstruction, and object placement. Four tasks—3D detection, 3D reconstruction, navigation, and loco‑manipulation—demonstrate that current methods struggle with dense object arrangements, occlusions, limited free space, and constrained interaction regions typical of realistic homes.

By Peijun Xu, Chuansen Nie, Yiyang He, Yinuo Bai, Jingyang Liu, Kuixiang Shao, Yuyang Jiao, Kuanhao Xia, Jiayi Zhu, Zitian Yang, Yanqi Zhang, Tianye Tan, Shuwei Di, Junyi Xu, Jingyi Yu, Jiayuan Gu
arXiv AI
Aug 7

iARCS: Iterative Agentic RL for Controllable 3D Scene Generation

arXiv:2608. 06161v1 Announce Type: new Abstract: Synthetic 3D scene generation is increasingly used as a data source for computer vision and embodied AI, but existing generators often optimize perceptual realism without reliably satisfying task-critical functional constraints.

By Saugat Adhikari, Ashok Prasad Neupane, Pramish Paudel, Ajad Chhatkuli, Danda Pani Paudel
Hugging Face Trending Papers
Jul 2

SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

LLM agents are increasingly used to translate natural language into 3D scenes in a procedural way, but existing systems focus on static output. Dynamic 4D scenes from text alone, in which liquids flow, particles emit, rigid bodies cascade, and articulated mechanisms move, remain largely unexplored despite their value as editable content and as physics-grounded training data for video generation and embodied AI.

arXiv Computer Vision
Oct 8

Agentic Scene Policies

arXiv:2509.19571v2 Announce Type: replace-cross Abstract: Designing or learning robot policies that generalize zero-shot across a range of language instructions and objects is a core problem in robot...

By Sacha Morin, Kumaraditya Gupta, Mahtab Sandhu, Charlie Gauthier, Francesco Argenziano, Kirsty Ellis, Liam Paull
arXiv Computer Vision
4d ago

SceneReVis: A Self-Reflective Vision-Grounded Framework for 3D Indoor Scene Synthesis via Multi-Turn RL

SceneReVis is a vision‑grounded, self‑reflective framework for 3D indoor scene synthesis that uses an iterative diagnose‑and‑act loop to detect and fix spatial conflicts such as collisions. It introduces SceneChain‑12k, a large dataset of causal construction trajectories generated via a reverse engineering pipeline, and employs a two‑stage training recipe that moves from supervised fine‑tuning to agentic reinforcement learning, turning the model into an active spatial planner. Experiments show that SceneReVis achieves state‑of‑the‑art performance in high‑fidelity generation and goal‑oriented optimization, with better transfer to underrepresented room categories and potential for out‑of‑distribution room types.

By Yang Zhao, Shizhao Sun, Meisheng Zhang, Yingdong Shi, Xubo Yang, Jiang Bian
arXiv Computer Vision
Sep 23

HARMONY: Hierarchical Agentic Reasoning for MONocular Image-to-Scene Synthesis

HARMONY is a hierarchical chain-of-thought framework that reconstructs complete 3D indoor scenes from a single monocular image. It combines agentic reasoning with visual geometry foundation models, starting with camera calibration and semantic layout recovery, then placing objects hierarchically while refining geometry with point cloud estimations. The method achieves semantically consistent scenes that align perceptually with the input image, outperforming existing baselines on synthetic and real-world data.

By Shufan Sun, Chen Wang, Enxin Song, Jiatao Gu, Lingjie Liu
arXiv AI
Oct 2

SPHERE: Adaptive VR Indoor Scene Generation via LLM-Enhanced Spatial Preference Learning and Human-in-the-Loop RL

SPHERE is an adaptive VR indoor scene generation framework that turns isolated 3D synthesis into continuous human‑AI co‑creation. It learns persistent spatial preferences from multimodal user interactions, abstracts these into hierarchical constraints for geometric resilience, and employs a human‑in‑the‑loop reinforcement learning loop to refine retrieval policies. A mixed‑design study with 42 participants and offline ablation show that SPHERE reduces corrective edits and physical effort while avoiding bias toward shallow object‑level traits, producing geometrically resilient, profile‑aligned layouts.

By Hyeonmin Lee, Zheng Wei, Kyungmin Kwon, Jumin Seo, Jiwon Park, Hayoung Oh