arXiv AI By Yunge Wen

Text-Driven Artistic Staging: 3D Posing, Lighting, and Camera References from Paintings

Read the original on arXiv AI →

The paper presents a method for generating 3D staging—human poses, lighting, and camera setup—directly from affective textual descriptions. It builds a dataset of 11,911 text–staging pairs derived from 2,328 figurative paintings, reconstructing SMPL bodies, estimating illumination, and recovering camera parameters. A flow‑matching transformer is trained to produce variable‑size scenes and multiple staging alternatives, achieving a 32.2% retrieval R@1 on held‑out prompts, outperforming a CLIP‑based baseline.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
5d ago

Autoregressive Diffusion for Compositional Text-to-Scene Generation

The paper introduces a new sequential text‑to‑scene generation framework that jointly produces scene layouts and objects. It proposes a 3D Autoregressive Diffusion model (3D‑ARD+) that first generates coarse 3D latents conditioned on text and the current scene, then refines them into fine‑grained object geometry and appearance. A large dataset of 230K indoor scenes with paired text instructions is curated for training, and the model demonstrates the ability to place objects according to complex spatial and semantic text prompts.

By Zhenggang Tang, Yuehao Wang, Yuchen Fan, Jun-Kun Chen, Yu-Ying Yeh, Kihyuk Sohn, Zhangyang Wang, Qixing Huang, Alexander Schwing, Rakesh Ranjan, Dilin Wang, Zhicheng Yan