arXiv Computer Vision
Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
6d ago
PhysCreator: Creating Physically-Attributed 3D Assets at Will
arXiv:2610.34473v1 Announce Type: new Abstract: Significant advancements in 3D asset creation have enabled high-fidelity 3D generation from images. However, most existing representations remain inher...
arXiv Computer Vision
Oct 21
HERMES++: Toward a Unified Driving World Model for 3D Scene Understanding and Generation
HERMES++ is a unified driving world model that simultaneously performs 3D scene understanding and future geometry prediction. It uses a BEV representation to merge multi‑view spatial data for LLM compatibility, introduces LLM‑enhanced world queries for knowledge transfer, and employs a Current‑to‑Future Link to condition future geometry on semantic context. A Joint Geometric Optimization strategy enforces structural integrity by combining explicit geometric constraints with implicit latent regularization, and extensive benchmark tests show that HERMES++ outperforms specialist methods in both point cloud prediction and scene understanding.
arXiv Computer Vision
Sep 15
Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion
arXiv:2605.04412v3 Announce Type: replace Abstract: 3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects fro...
Hugging Face Trending Papers
4d ago
LucidLyra: Feed-Forward Generative 3D Scene Reconstruction and Joint Understanding via Multi-Task Distillation
LucidLyra is a framework that reconstructs 3D scenes from video latents in a feed‑forward manner while simultaneously providing open‑vocabulary semantics and instance cues. By distilling knowledge from a camera‑controlled video diffusion model and frozen 2D vision foundation models, it jointly infers 3D Gaussians that encode geometry, appearance, and semantic information without requiring per‑scene optimization or manual 3D annotations. The resulting scenes support novel‑view rendering, open‑vocabulary segmentation, and object grouping, and can be extended to monocular video for dynamic 3D reconstruction.
arXiv Computation and Language
Sep 30
Imagine3D-LLM: Teaching MLLMs to Imagine 3D Scenes Before Answering
arXiv:2609.38177v1 Announce Type: cross Abstract: Reasoning about the 3D world from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While modern MLLMs...
arXiv Computer Vision
Sep 7
Learning 3D Editing without Paired Supervision via Generative Prior Distillation
The paper introduces a framework for instruction‑guided 3D editing that does not require paired 3D supervision. It distills visual, semantic, and geometric knowledge from foundation models into a 3D editing model using a differentiable rendering pipeline, guided by a 2D visual prior from an image editing model and a semantic prior from a Vision‑Language Model. A 3D‑aware Distribution Matching regularization is added to prevent geometric collapse and ensure realistic 3D outputs, leading to superior instruction fidelity and cross‑view consistency compared to state‑of‑the‑art baselines.