arXiv AI
Oct 21

World2HOSI: A Multi-Expert Harness for Long-Horizon Human-Object-Scene Interaction Generation

World2HOSI is a multi‑expert harness that generates long‑horizon human‑object‑scene interaction (HOSI) data by orchestrating existing human‑object interaction (HOI) and human‑scene interaction (HSI) models. It builds a persistent scene state from decoupled background and object assets, plans action stages, invokes experts via their native interfaces, and updates the scene after each action, ensuring physical plausibility through bounded residual optimization and contact‑driven physics simulation. Experiments and a perceptual user study demonstrate that World2HOSI achieves superior task completion and interaction quality while producing more diverse data than prior approaches.

By Jiushu Li, Haoran Wang, Yumeng Liu, Zhiyang Dou, Yuan Liu, Yuexin Ma, Cheng Lin
Hugging Face Trending Papers
Jul 2

SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

LLM agents are increasingly used to translate natural language into 3D scenes in a procedural way, but existing systems focus on static output. Dynamic 4D scenes from text alone, in which liquids flow, particles emit, rigid bodies cascade, and articulated mechanisms move, remain largely unexplored despite their value as editable content and as physics-grounded training data for video generation and embodied AI.