arXiv AI By Akshay Krishnan, Matias Turkulainen, Jamie Wynn, Zawar Qureshi, Mohamed Sayed, Guillermo Garcia-Hernando, Sara Vicente, James Hays, Michael Firman, Daniyar Turmukhambetov

GroundControl: Satellite-Conditioned Multi-View Diffusion for Reconstruction-Free Novel View Synthesis

Read the original on arXiv AI →

GroundControl introduces a satellite-conditioned multi‑view diffusion model for novel view synthesis that leverages both satellite imagery and street‑level inputs. The approach uses cross‑attention conditioning to preserve pretrained diffusion priors while aligning generated views with the scene layout seen from satellite images, avoiding unrealistic hallucinations. Experiments on outdoor datasets demonstrate superior performance over baselines, particularly when target views have minimal overlap with source views.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Oct 27

GroundControl: Satellite-Conditioned Multi-View Diffusion for Reconstruction-Free Novel View Synthesis

GroundControl introduces a satellite‑conditioned multi‑view diffusion model for novel view synthesis that uses satellite images alongside street‑level inputs. The cross‑attention conditioning preserves pretrained diffusion priors while ensuring realistic spatial layouts, even when target views have little overlap with source views. Experiments on outdoor datasets demonstrate superior performance over both satellite‑only and street‑only baselines without relying on 3D reconstruction.

arXiv Computer Vision
Oct 23

MeSS: City Mesh-Guided Outdoor Scene Generation with Cross-View Consistent Diffusion

MeSS (Mesh-based Scene Synthesis) is a method that generates high‑quality, style‑consistent outdoor scenes using city mesh models as geometric priors. The pipeline first creates geometrically consistent sparse views with Cascaded Outpainting ControlNets, then densifies intermediate views via AGInpaint, and finally removes visual inconsistencies with GCAlign. Simultaneously, a 3D Gaussian Splatting scene is reconstructed from the mesh, enabling diverse rendering styles after synthesis.

By Xuyang Chen, Zhijun Zhai, Kaixuan Zhou, Zengmao Wang, Jianan He, Dong Wang, Yanfeng Zhang, Mingwei Sun, Xuqin Wang, R\"udiger Westermann, Tao Wu, Konrad Schindler, Liqiu Meng
arXiv Computer Vision
Oct 15

VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis

arXiv:2609.33253v2 Announce Type: replace Abstract: We present VGGT-Diff, a geometry-routed multi-view diffusion model for sparse-view novel view synthesis. Existing novel view synthesis (NVS) method...

By Kangjie Chen, Xiangyu Li, Dongbin Zhang, Chaoda Zheng, Shijia Chen, Jinhao Deng, Hongbin Lin, Choo Sin Wai, Minqi Wang, Minghao Yang, Dake Zhong, Guorui Song, Yu Zhang, Xianming Liu, Boyang Wang
arXiv Computer Vision
Oct 9

LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generation

The paper introduces LEGO, a lifting‑free method for generating egocentric videos from a single exocentric recording. Instead of reconstructing depth and point clouds, it trains a transformer‑based view synthesizer that directly predicts the egocentric view, providing a probabilistic correspondence map that balances structural alignment with texture averaging. This approach outperforms existing explicit pipelines and generalizes across datasets without retraining.

By Suhwan Cho, Yonwoo Choi, Soongjin Kim, Jicheol Park, Taegyu Lim