arXiv AI By Luke Hollis, Tianxing Fan, Heng Yang

SceneAgent: An Agentic Pipeline from 3D and 4D Captures to Simulation Environments

Read the original on arXiv AI →

SceneAgent is an agentic pipeline that transforms 3D and 4D visual captures—such as 3D Gaussian Splatting, photogrammetry, LiDAR, AI‑generated scenes, and dynamic 4D videos—into interactive simulation environments. It coordinates object reconstruction, physical modeling, part decomposition, articulation, and deformable simulation, and then generates diverse object variants and scripted demonstrations to support policy learning. In benchmark tests, SceneAgent outperforms SimFoundry on cluttered bin scenes and dramatically improves dynamic IoU on 4DCodeBench, while also enabling simulated interactions and preliminary real‑robot policy transfer.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.