arXiv Computer Vision By Xiaotian Chen, Dongfu Yin

MATE4D: Matrix-Guided Editable 4D Generation from a Single Image

Read the original on arXiv Computer Vision →

MATE4D is a framework that transforms a single image into editable dynamic 4D content. It builds a spatio-temporal multi-view image matrix with text-guided background manipulation, then optimizes 3D Gaussian primitives and animates them with a lightweight deformation module. The approach yields scenes with more faithful geometry, smoother temporal behavior, and consistent background edits, outperforming baselines on Objaverse-XL and Diffusion4D.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
3d ago

Edit4D: Editable 4D Scene Generation with Textual Control

Edit4D is a new text‑to‑4D scene generation framework that builds editable 4D scenes by separately modeling background and dynamic characters. It decomposes user instructions into stage‑specific prompts for background, character, and composition, then uses text‑to‑image, camera‑conditioned priors, and image‑conditioned video priors to synthesize multi‑view images, reconstruct 3D Gaussian splatting backgrounds, animate characters into 4D meshes, and finally compose and refine the scene with text‑guided segmentation and contact‑aware optimization. This pipeline allows controllable camera motion, flexible object‑level editing, and practical construction of editable 4D scenes.

By Chanwoo Kim, Tackgeun You, Hwasup Lim
arXiv Computer Vision
Sep 11

Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation

Dream4D is a new framework for generating spatiotemporally coherent 4D content. It uses a two‑stage pipeline: first, few‑shot learning predicts optimal camera trajectories from a single image; second, a pose‑conditioned diffusion process creates geometrically consistent multi‑view sequences that are converted into a persistent 4D representation. The method uniquely combines rich temporal priors from video diffusion models with geometric awareness from reconstruction models, achieving higher quality metrics such as mPSNR and mSSIM compared to existing approaches.

By Xiaoyan Liu, Kangrui Li, Jiaxin Liu, Yuehao Song, Yujie Xing
arXiv Computer Vision
Sep 1

CL4D: Contrastive Language-4D Pretraining for Vision-Language Reasoning in Dynamic Scenes

arXiv:2608.18734v2 Announce Type: replace Abstract: 4D understanding and reasoning is a fundamental capability for embodied AI agents operating in dynamic physical environments. However, existing vis...

By Kumal Hewagamage, Isuranga Senavirathne, Sasika Amarasinghe, Hasitha Gallella, Dulanga Weerakoon, Vigneshwaran Subbaraju, Ranga Rodrigo
arXiv Computer Vision
Oct 2

4Director: Controlling Video World Models with Rigid 3D Geometry

arXiv:2610.02160v1 Announce Type: new Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through i...

By Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu