Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editing
arXiv:2603. 03143v2 Announce Type: replace-cross Abstract: Leveraging the priors of 2D diffusion models for 3D editing has emerged as a promising paradigm.
The paper introduces a framework for instruction‑guided 3D editing that does not require paired 3D supervision. It distills visual, semantic, and geometric knowledge from foundation models into a 3D editing model using a differentiable rendering pipeline, guided by a 2D visual prior from an image editing model and a semantic prior from a Vision‑Language Model. A 3D‑aware Distribution Matching regularization is added to prevent geometric collapse and ensure realistic 3D outputs, leading to superior instruction fidelity and cross‑view consistency compared to state‑of‑the‑art baselines.
arXiv:2603. 03143v2 Announce Type: replace-cross Abstract: Leveraging the priors of 2D diffusion models for 3D editing has emerged as a promising paradigm.
arXiv:2610.27049v1 Announce Type: new Abstract: Recent advances in unified visual editing have begun to consolidate image and video editing within a single model, while 3D scene editing remains large...
The paper introduces SAGE, a framework that adapts 3D geometric foundation models using weak supervision from raw Internet videos. SAGE employs a hierarchical mining pipeline to generate informative training trajectories, sparse geometric anchoring via SfM point clouds, and dense differentiable consistency through 3D Gaussian rendering, while also replaying a small amount of supervised data to avoid catastrophic forgetting. Experiments on two different backbones show that SAGE reduces Chamfer Distance on unseen benchmarks by 20–42% and consistently improves performance, demonstrating that Internet video can serve as a scalable source for geometric learning.
arXiv:2610.35756v1 Announce Type: new Abstract: Recent advancements in text-guided 3D editing, particularly with 3D Gaussian Splatting (3DGS), have shown promise but still lag behind the flexibility...
OREO is a framework that improves the visual fidelity of 3D generation models by using on-the-fly rendered and edited 2D views as pseudo-targets. It introduces a dynamic optimization loop where a 2D diffusion model refines rendered views, preserving geometry, viewpoint, and content while enhancing realism. These refined views serve as high‑quality supervision, enabling the 3D generator to learn from its own outputs and progressively improve its visual quality, outperforming pre‑trained baselines.
arXiv:2608.23549v1 Announce Type: new Abstract: Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces...
Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target v...
arXiv:2508.01684v2 Announce Type: replace Abstract: While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains...
Despite recent advancements in 3D generation, models often struggle to produce assets with high visual fidelity. To bridge this gap, we propose OREO, an alignment framework that enhances the realism o...
arXiv:2606.13345v2 Announce Type: replace Abstract: Existing 3D scene editing methods typically rely on per-scene optimization over explicit 3D representations or cascaded edit-and-reconstruct pipeli...
arXiv:2511.21265v2 Announce Type: replace Abstract: Learning-based image matching critically depends on large-scale, diverse, and geometrically accurate training data. 3D Gaussian Splatting (3DGS) en...
arXiv:2607.07187v2 Announce Type: replace Abstract: Local editing of 3D objects remains a long-standing challenge. When interacting with 3D content, humans naturally tend to specify a coarse region o...