arXiv Machine Learning By Nicky Kriplani, Yiwen Zhang, Angelina Wang, Hadar Averbuch-Elor

Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models

Read the original on arXiv Machine Learning →

The paper introduces ArchWorld, a benchmark of 3D architectural landmarks with extensive geographic coverage and detailed metadata, to evaluate and analyze the performance of 3D foundation models (3DFMs). Through a comprehensive error analysis, the authors uncover geographic disparities in model accuracy that stem from variations in data representation, scene size, and region-specific architectural features. They propose an intervention scheme that enhances 3DFM performance while simultaneously reducing these geographic disparities.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers
Jun 1

Honey, I Shrunk the Arc de Triomphe!

Metric scale monocular geometry estimation has seen significant progress through large-scale data aggregation, yet current foundation models suffer from a persistent ''scale-collapse'' phenomenon: distant landmarks and vast landscapes are metrically underestimated. We hypothesize that this performance gap stems from a training data bottleneck, where existing metric-scale datasets are hardware-constrained to homogenous vehicle-captured LiDAR or short-range indoor scans, or consist of synthetic data that lacks the semantic complexity of the physical world.

arXiv Computer Vision
Oct 9

Pumpire: Unified Benchmark for Metric Distance Estimation

Pumpire introduces a unified benchmark for assessing metric point‑pair distance estimation in both image‑ and video‑level 3D foundation models, with or without depth priors. The benchmark uses a large, diverse dataset (pumpire‑6k) of 100 real‑world scenes, each annotated with physically measured point‑pair distances across 64 frames, totaling 6,400 frames. An evaluation protocol is provided that directly measures point‑to‑point distance errors, enabling cross‑setting comparison across 29 baseline 3D models.

By Siyu Chen, Zehan Wang, Jiayang Xu, Yihan Wu, Jialei Wang, Junming Chen, Ziang Zhang, Yutong Ying, Zhou Zhao
arXiv AI
Oct 15

Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective

arXiv:2604.14025v2 Announce Type: replace-cross Abstract: Reconstructing 3D representations from 2D inputs is a fundamental task in computer vision and graphics, serving as a cornerstone for understa...

By Weijie Wang, Qihang Cao, Sensen Gao, Donny Y. Chen, Haofei Xu, Wenjing Bian, Songyou Peng, Tat-Jen Cham, Chuanxia Zheng, Andreas Geiger, Jianfei Cai, Jia-Wang Bian, Bohan Zhuang
arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan