arXiv Computer Vision

Chat-Edit-3D++: Interactive 3D and 4D Scene Editing via Large Language Models

The paper introduces Chat-Edit-3D++ (CE3D++), an interactive 3D and 4D scene editing system that uses a Hash-Atlas network to separate 2D editing from 3D reconstruction. CE3D++ employs a large language model to accept arbitrary textual input, interpret user intent, and autonomously invoke appropriate visual models, enabling multi‑round dialogue and diverse editing effects. The approach is extended to monocular 4D scenes by adding motion constraints and a trajectory dataset, allowing a smaller LLM to schedule up to 30 visual tools accurately.

arXiv Computer Vision
Aug 27

TASE: Truncation-Aware Semantic Embeddings for 3D Scene Understanding and Editing

TASE introduces a truncation‑aware embedding space that projects pretrained 2D semantic features into 3D scene representations, allowing flexible and controllable editing. The method optimizes feature channels so that fewer channels yield abstract semantics while more channels preserve detail, and it enforces multi‑view consistency with a scale‑ and translation‑equivariant loss. A finetuning stage for the editing diffusion model further reduces artifacts from geometric changes, achieving competitive performance and outperforming prior methods on large‑scale geometric edits.

By Tim-Felix Faasch, Jochen Kall, Lucas Nunes, Jens Behley, Cyrill Stachniss
Hugging Face Trending Papers
Jul 15

ThinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning

While traditional graphics methods often synthesize 3D indoor scenes autoregressively or hierarchically, recent vision-language model (VLM)-based generators predominantly adopt a one-shot paradigm where the full layout is planned at once. This one-shot approach often requires global re-optimization or complete reconstruction during interactive editing (e.

Hugging Face Trending Papers
Jul 2

SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation

LLM agents are increasingly used to translate natural language into 3D scenes in a procedural way, but existing systems focus on static output. Dynamic 4D scenes from text alone, in which liquids flow, particles emit, rigid bodies cascade, and articulated mechanisms move, remain largely unexplored despite their value as editable content and as physics-grounded training data for video generation and embodied AI.

Hugging Face Trending Papers
Jun 8

EditSSC: Toward Editable Semantic Occupancy Scenes with Unconditional Diffusion Models

3D semantic scene generation is crucial for autonomous driving applications, yet most methods rely on complex 3D-specific architectures such as triplane encoders and adapted diffusion networks, limiting both their simplicity and their editing capabilities. We propose EditSSC, an editing-ready method for 3D semantic scene generation using 2D Bird's Eye View (BEV) representations and off-the-shelf latent diffusion network.