arXiv Computer Vision
GeoWM: Efficient Direct World Modeling in Explicit Geometry
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Aug 25
GeoWAM: Visual Geometry World Action Models for Autonomous Driving
GeoWAM introduces a visual geometry world action model that predicts future scene geometry instead of future images, using point clouds to capture spatial structure and transformations. The model is pretrained to forecast geometry, then a geometry-conditioned action head predicts ego trajectories. Experiments show that this geometry-based approach yields stronger driving policies than image-based alternatives.
arXiv Computer Vision
Sep 22
Revisiting Multi-View Stereo: A Sequence-to-Sequence Formulation
The paper proposes a new sequence-to-sequence formulation for multi-view stereo (MVS) that jointly predicts 3D geometry for all input views using a global transformer architecture. It introduces ray‑map embeddings to inject camera parameters into image tokens and a unified global cost volume to capture 3D structure across all views. Experiments on public benchmarks demonstrate state‑of‑the‑art performance, outperforming both traditional MVS and feed‑forward reconstruction baselines.
arXiv Machine Learning
Jul 23
WorldPack: Dynamic Frame Compression for Long-context Video World Modeling
arXiv:2512. 02473v2 Announce Type: replace-cross Abstract: Video world models have attracted significant attention for their ability to produce high-fidelity future visual observations conditioned on past observations and navigation actions.
arXiv AI
Oct 1
DiffWAM: A Fast and Efficient Navigation World Action Model
DiffWAM is a geometry‑conditioned navigation world‑action model that transforms predictive features from a frozen video foundation model into continuous camera trajectories, eliminating the need for future‑video synthesis and multi‑frame reconstruction during deployment. Its Grid‑Motion module preserves spatial‑temporal motion associations, while Latent2Pose grounds them with first‑frame geometry to recover metrically meaningful 3D motion. The system, complemented by FastDreamer for asynchronous trajectory handoff, achieves a trajectory RMSE of 0.3492 m and a 74.40 % endpoint success rate on the DiffWAM‑1000 benchmark, with real‑world tests showing complex UAV behaviors and an onboard implementation reaching 1.08 s latency on NVIDIA Jetson AGX Thor.
arXiv AI
Jun 4
DVGT: Driving Visual Geometry Transformer
arXiv:2512. 16919v2 Announce Type: replace-cross Abstract: Perceiving and reconstructing 3D scene geometry from visual inputs is crucial for autonomous driving.
arXiv Computer Vision
Aug 31
Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction
arXiv:2608.27529v1 Announce Type: new Abstract: Streaming 3D reconstruction from extremely long videos requires estimating camera motion and scene geometry online under bounded memory and computation...