arXiv AI

POCI-Diff: 3D-Layout Guided Diffusion for Controllable Synthetic Surveillance Data Generation

Hugging Face Trending Papers
Jun 17

LooseControlVideo: Directorial Video Control using Spatial Blocking

Precise 3D spatial orchestration in text-to-video generation remains a significant challenge, particularly for multi-object scenes where semantic layout and temporal dynamics are often entangled. While existing depth-conditioned models achieve good structural fidelity, they necessitate dense, frame-accurate guidance that is labor-intensive to author for dynamic events involving deformable objects.

arXiv Computer Vision
Aug 27

TASE: Truncation-Aware Semantic Embeddings for 3D Scene Understanding and Editing

TASE introduces a truncation‑aware embedding space that projects pretrained 2D semantic features into 3D scene representations, allowing flexible and controllable editing. The method optimizes feature channels so that fewer channels yield abstract semantics while more channels preserve detail, and it enforces multi‑view consistency with a scale‑ and translation‑equivariant loss. A finetuning stage for the editing diffusion model further reduces artifacts from geometric changes, achieving competitive performance and outperforming prior methods on large‑scale geometric edits.

By Tim-Felix Faasch, Jochen Kall, Lucas Nunes, Jens Behley, Cyrill Stachniss
arXiv AI
23h ago

Bernini: Latent Semantic Planning for Video Diffusion

Bernini proposes a unified framework that separates semantic planning and pixel rendering for video generation and editing. An MLLM-based planner predicts target semantics in ViT embedding space, while a DiT-based renderer synthesizes pixels conditioned on this plan, text features, and source VAE features for editing. The approach introduces Segment-Aware 3D Rotary Positional Embedding and chain-of-thought reasoning, achieving state‑of‑the‑art performance on diverse video benchmarks.

By Bernini Team, Chenchen Liu, Junyi Chen, Lei Li, Lu Chi, Mingzhen Sun, Zhuoying Li, Yi Fu, Ruoyu Guo, Yiheng Wu, Ge Bai, Zehuan Yuan
Hugging Face Trending Papers
Jul 21

IGGT4D: Streaming 4D Instance-Grounded Geometry Transformer

Real-world spatial intelligence requires agents to understand scenes from continuous video streams, where objects move, persist, disappear, and reappear over time. While recent spatial foundation models have enabled generalizable feed-forward 3D reconstruction, most streaming methods remain geometry-centric and lack temporally consistent object-level understanding.

arXiv Computer Vision
2d ago

Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models

The paper introduces Chat-Edit-3D++ (CE3D++), an interactive 3D and 4D scene editing system that uses a Hash-Atlas network to separate 2D editing from 3D reconstruction. CE3D++ employs a large language model to accept arbitrary textual input, interpret user intent, and autonomously invoke appropriate visual models, enabling multi‑round dialogue and diverse editing effects. The approach is extended to monocular 4D scenes by adding motion constraints and a trajectory dataset, allowing a smaller LLM to schedule up to 30 visual tools accurately.

By Shuangkang Fang, Yufeng Wang, Yi-Hsuan Tsai, Wenrui Ding, Yi Yang, Shuchang Zhou, Ming-Hsuan Yang