The paper surveys 3D generation techniques tailored for embodied AI and robotics, emphasizing that beyond visual realism, generated content must include kinematic structure, material properties, and interaction capabilities. It categorizes the literature into three roles: Data Generator, Simulation Environments, and Sim2Real Bridge, each addressing different needs in training and deployment. The survey highlights a shift toward interaction readiness and identifies key bottlenecks such as limited physical annotations, quality gaps, fragmented evaluation, and the sim‑to‑real divide.
arXiv:2610.27690v1 Announce Type: new Abstract: Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We...
arXiv:2610.07969v1 Announce Type: new Abstract: Scaling robotic foundation models requires diverse training data and reliable evaluation environments. Simulation offers a scalable solution, yet exist...
arXiv:2606.17446v2 Announce Type: replace-cross Abstract: Simulation enables scalable robot data collection, but raw 3D assets provide only geometry, lacking the semantic, interactive, and physical k...
arXiv:2610.20560v1 Announce Type: cross Abstract: 3D object composition is pivotal to digital content creation and robot simulation, while also serving as a critical testbed for physical intelligence...
arXiv:2607. 19190v1 Announce Type: cross Abstract: Real-to-sim conversion for robotic interaction with objects remains labor-intensive because it requires more than visual reconstruction: a streamlined real2sim process must recover scene geometries and object states, infer physical parameters, and assemble actors, objects, cameras, poses, and trajectories into a runnable physical simulation.
Simulation-ready world reconstruction demands physical interactivity beyond visual realism, which existing black-box 3D generation fails to deliver. We present NeoWorld-3, a coding-agent framework tha...
arXiv:2606. 06390v1 Announce Type: cross Abstract: Indoor scene generation is crucial for robot simulation and modern interior design.
SMART introduces a scalable system for zero‑shot sim‑to‑real articulated object manipulation by leveraging large‑scale synthetic pretraining. The core component, SMART‑Sim, is an articulation‑aware simulation platform that facilitates efficient task generation and demonstration collection. Using SMART‑Sim, the authors synthesize SMART‑Data, comprising over 1 million demonstrations across 44 task types, 5 robot setups, and 2,507 articulated objects, and demonstrate that a vision‑language‑action model pretrained on this data achieves competitive simulation performance and zero‑shot transfer to real‑world tasks.
WorldMirror is a real‑to‑sim framework that builds interactive digital twins from real‑world robot demonstrations by iteratively refining an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and coordinates image and 3D generation tools, using verification feedback to correct errors. The resulting camera‑pose‑anchored scene representation preserves spatial relationships and enables physically consistent interaction and trajectory replay, as shown on the DROID dataset.
RoboPhys-3D is a 3D‑grounded embodied world model benchmark built on RoboTwin 2.0, featuring 50 manipulation tasks, 5,000 episodes, and 25,000 multi‑view ground‑truth videos. It evaluates video world models by processing both generated and ground‑truth videos through the same 3D reconstruction pipeline, allowing the separation of reconstruction‑induced from generation‑induced errors. The benchmark defines 50 metrics across four sub‑dimensions—pixel fidelity, 3D geometry consistency, state understanding, and task completeness—and introduces the Average Full Score and RoboPhyscore for holistic assessment, with RoboPhyscore showing strong correlation with human judgments.
arXiv:2610.04432v2 Announce Type: replace Abstract: Building interactive simulators from real-world observations is a promising way to scale embodied data, but current pipelines still rely heavily on...
arXiv:2607. 11643v1 Announce Type: cross Abstract: Recent foundation image and video generation models offer strong generalization and controllability, but their direct application to embodied scenarios is limited by requirements for multi-view consistency, geometric coherence, and robot embodiment constraints.