arXiv AI

Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction

arXiv Computer Vision
Sep 24

SatUnreal: A High-Precision Synthetic Dataset for Satellite Stereo Matching via Unreal Engine

SatUnreal is a synthetic dataset created with Unreal Engine that offers 10,000 high‑resolution (0.3 m GSD) satellite stereo pairs. It addresses key limitations of existing benchmarks by ensuring physical geometry simulation, spatio‑temporal consistency, topographic diversity, and mathematically precise occlusion masks via a two‑step line‑trace algorithm. Models trained solely on SatUnreal outperform those trained on real datasets when transferred to real‑world benchmarks such as US3D and WHU‑Stereo.

By Han-Gyeol Kim, JaeWan Park, Junmin Park, Darongsae Kwon
arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv Computer Vision
Oct 16

Auditing Metrics for Synthetic Data Utility: A Cross-Domain Study of Appearance and Geometry

The paper introduces SADGE, a quantitative similarity metric that predicts how well synthetic image datasets will perform on real-world computer vision tasks without requiring downstream model training. SADGE combines appearance and geometric similarity measures through a constrained bilinear interaction, outperforming appearance-only and geometry-only baselines across 79,000 image pairs in five synthetic-to-real benchmark families. The study demonstrates that the non‑linear interplay between appearance and geometry, rather than either alone, best predicts downstream performance in tasks such as object detection, semantic segmentation, and pose estimation.

By Patryk Bartkowiak, Dominik Michels, Soren Pirk, Wojtek Palubicki