arXiv Computer Vision
GTA: Advancing Image-to-3D World Generation via Geometry Then Appearance Video Diffusion
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Aug 28
SpatialCrafter: Single Image World Modeling with Generative 3D Proxies
SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.
arXiv Computer Vision
Sep 30
GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
arXiv:2609.35734v2 Announce Type: replace Abstract: Novel view synthesis from sparse images must reconcile faithful reconstruction of observed regions with plausible completion of unseen content, whi...
arXiv Computer Vision
Aug 31
Video Generative Models as Geometry Learner
The paper introduces GeoNeXt, a framework that repurposes pretrained video generative models for geometry estimation by framing it as a next‑frame prediction task. Unlike prior methods that either train separate depth/normal models or fine‑tune image diffusion backbones, GeoNeXt jointly models images and geometric targets, leveraging the structured knowledge of video models for more data‑efficient learning. Experiments show zero‑shot monocular depth and surface normal estimation that outperforms existing generative approaches and rivals discriminative state‑of‑the‑art methods while using far less training data.
arXiv Computer Vision
Oct 23
MeSS: City Mesh-Guided Outdoor Scene Generation with Cross-View Consistent Diffusion
MeSS (Mesh-based Scene Synthesis) is a method that generates high‑quality, style‑consistent outdoor scenes using city mesh models as geometric priors. The pipeline first creates geometrically consistent sparse views with Cascaded Outpainting ControlNets, then densifies intermediate views via AGInpaint, and finally removes visual inconsistencies with GCAlign. Simultaneously, a 3D Gaussian Splatting scene is reconstructed from the mesh, enabling diverse rendering styles after synthesis.
arXiv Computer Vision
Oct 22
NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering
NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.
arXiv Computer Vision
Sep 1
ReconSplat: Generalizable 3D Scene Reconstruction Beyond Observed Views
arXiv:2608.28895v1 Announce Type: new Abstract: We introduce ReconSplat, a feed-forward model for 3D scene reconstruction that aims to address the longstanding trade-off between plausible view genera...