Simulation is a powerful tool for robotics, but building diverse, simulation-ready scenes at scale remains difficult. Reconstructing scenes from single images is a promising alternative, but visual si...
WorldMirror is a real‑to‑sim framework that builds interactive digital twins from real‑world robot demonstrations by iteratively refining an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and coordinates image and 3D generation tools, using verification feedback to correct errors. The resulting camera‑pose‑anchored scene representation preserves spatial relationships and enables physically consistent interaction and trajectory replay, as shown on the DROID dataset.
SceneAgent is an agentic pipeline that transforms 3D and 4D visual captures—such as 3D Gaussian Splatting, photogrammetry, LiDAR, AI‑generated scenes, and dynamic 4D videos—into interactive simulation environments. It coordinates object reconstruction, physical modeling, part decomposition, articulation, and deformable simulation, and then generates diverse object variants and scripted demonstrations to support policy learning. In benchmark tests, SceneAgent outperforms SimFoundry on cluttered bin scenes and dramatically improves dynamic IoU on 4DCodeBench, while also enabling simulated interactions and preliminary real‑robot policy transfer.
arXiv:2608.24212v1 Announce Type: new Abstract: The advancement of Embodied AI necessitates high-quality simulation assets that faithfully mirror the real world. However, transforming raw visual obse...
The advancement of Embodied AI necessitates high-quality simulation assets that faithfully mirror the real world. However, transforming raw visual observations into simulation-ready scenes remains cha...
arXiv:2608.30821v1 Announce Type: cross Abstract: Composable scene modeling aims to recover a real indoor scene as complete, editable object assets arranged as observed, giving robot simulation and e...
arXiv:2610.27690v1 Announce Type: new Abstract: Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We...
PhyMix introduces a Physics Evaluator that checks geometric priors, contact, stability, and deployability through nine sub-constraints, establishing a benchmark for physical consistency in single-image 3D indoor scene generation. The framework uses implicit alignment via Scene-GRPO and explicit refinement through verifier-guided agentic repair to incorporate evaluator feedback during training and inference, improving physical plausibility while preserving scene content. Experiments demonstrate enhanced reconstruction quality and physical plausibility, with qualitative results on stylized and real-world images showing the method’s broader applicability.
Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We present NeoWorld-3, a coding-agent framework tha...
arXiv:2609.23103v1 Announce Type: cross Abstract: While simulation-ready deformable assets are essential for in-silico robotic manipulation tasks, existing generation frameworks typically assess phys...
GRASE is a new agentic framework for converting real-world video into editable 3D scenes while preserving geometry and layout. It treats captured multi‑view video as a persistent reference, revising intermediate hypotheses whenever rendered evidence conflicts with the capture. By iteratively refining architectural shells, asset placement, and geometry with cross‑view feedback, GRASE produces faithful, consistent scenes that outperform existing state‑of‑the‑art methods.
RoboCousin is an extensible simulation platform that transforms user-provided observations into reusable assets, scenes, and expert trajectories for bimanual robotic manipulation. It converts object images into simulation-ready models with visual, collision, semantic, and physical metadata, automatically generates grasp candidates, and builds digital cousins that vary objects, backgrounds, layouts, and language instructions while preserving task-relevant affordances. The platform supports both tabletop and room-level scene construction, and the authors release RoboCousin-OBD with over 3,000 annotated objects and 50 backgrounds, generating more than one million expert trajectories across 50 tasks, with simulation and real-robot experiments demonstrating comparable annotation quality and effective sim-to-real transfer.