WorldMirror: Agentic Real-to-Sim Generation of Interactive Worlds from In-the-Wild Robot Demonstrations

WorldMirror is a real‑to‑sim framework that builds interactive digital twins from real‑world robot demonstrations by iteratively refining an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and coordinates image and 3D generation tools, using verification feedback to correct errors. The resulting camera‑pose‑anchored scene representation preserves spatial relationships and enables physically consistent interaction and trajectory replay, as shown on the DROID dataset.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

• agents
• robotics