arXiv AI
Jul 21

Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models

arXiv:2607. 16409v1 Announce Type: cross Abstract: Unified Multimodal Large Language Models (MLLMs) offer a promising paradigm for unifying visual understanding and generation, yet they still struggle to follow complex spatial instructions and logical constraints in controllable image generation.

By Junhao Liu, Jian-Wei Zhang, Tao Huang, Miles Yang, Zhao Zhong, Liefeng Bo
arXiv AI
Aug 25

Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation

Object-Uni is a unified model that integrates pose perception, spatial reasoning, pose-conditioned generation, and novel view synthesis for object-centric spatial understanding and controllable image generation. It treats object pose as an explicit geometric variable shared across tasks and introduces a viewpoint-based orientation abstraction to make pose interpretable by multimodal large language models. The authors also create a new benchmark, UniSpatial-80K, and demonstrate that Object‑Uni improves both pose understanding and pose‑controllable generation compared to existing models.

By Mining Tan, Yinuo Wang, Ziqi Zhou, Weize Quan, Sifei Li, Jingdong Chen, DanDan Zheng, Libin Wang, Weiming Dong