← Back to all news

Related stories

arXiv Computer Vision
3d ago

WorldMirror: Agentic Real-to-Sim Generation of Interactive Worlds from In-the-Wild Robot Demonstrations

WorldMirror is a real‑to‑sim framework that builds interactive digital twins from real‑world robot demonstrations by iteratively refining an executable world program. A coding agent decomposes the observed scene, plans reconstruction steps, and coordinates image and 3D generation tools, using verification feedback to correct errors. The resulting camera‑pose‑anchored scene representation preserves spatial relationships and enables physically consistent interaction and trajectory replay, as shown on the DROID dataset.

By Tianling Xu, Weijie Wan, Honghao Su, Kailun Su, Junyuan Tang, Huichi Zhou, Haozheng Zhang, Qi Xiong, Ping Luo, Wenbo Ding, Tianxing Chen, Yue Chen
agentsrobotics
More like this →
arXiv Computer Vision
3d ago

3D Generation for Embodied AI and Robotic Simulation: A Survey

The paper surveys 3D generation techniques tailored for embodied AI and robotics, emphasizing that beyond visual realism, generated content must include kinematic structure, material properties, and interaction capabilities. It categorizes the literature into three roles: Data Generator, Simulation Environments, and Sim2Real Bridge, each addressing different needs in training and deployment. The survey highlights a shift toward interaction readiness and identifies key bottlenecks such as limited physical annotations, quality gaps, fragmented evaluation, and the sim‑to‑real divide.

By Tianwei Ye, Yifan Mao, Minwen Liao, Jian Liu, Chunchao Guo, Dazhao Du, Quanxin Shou, Fangqi Zhu, Song Guo
agentsrobotics
More like this →