arXiv Computer Vision
How Representational Priors Shape Generalization in World Action Models
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Aug 31
Video Generative Models as Geometry Learner
The paper introduces GeoNeXt, a framework that repurposes pretrained video generative models for geometry estimation by framing it as a next‑frame prediction task. Unlike prior methods that either train separate depth/normal models or fine‑tune image diffusion backbones, GeoNeXt jointly models images and geometric targets, leveraging the structured knowledge of video models for more data‑efficient learning. Experiments show zero‑shot monocular depth and surface normal estimation that outperforms existing generative approaches and rivals discriminative state‑of‑the‑art methods while using far less training data.
arXiv Machine Learning
4d ago
LocaLeJEPA: Maximum Entropy Representations under Geometric Priors
LocaLeJEPA extends Joint-Embedding Predictive Architectures (JEPA) by introducing a manifold-theoretic reformulation that aligns representation learning with non‑Euclidean geometric priors. It incorporates a locally Euclidean distribution‑matching regularizer, LocaLeReg, to stabilize training and scale to large models. Experiments on ImageNet‑1K show that LocaLeJEPA outperforms the original LeJEPA across both hyperbolic and Euclidean backbones, improving linear and k‑NN classification as well as downstream tasks.
arXiv AI
Jun 11
Making Foresight Actionable: Repurposing Representation Alignment in World Action Models
arXiv:2606. 12217v1 Announce Type: cross Abstract: World Action Models (WAMs) offer a promising route for robot manipulation by using video generation models to model future scene evolution before producing control actions.
arXiv Computer Vision
Sep 30
GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
arXiv:2609.35734v2 Announce Type: replace Abstract: Novel view synthesis from sparse images must reconcile faithful reconstruction of observed regions with plausible completion of unseen content, whi...
arXiv AI
Jun 2
Global Geometry Is Not Enough for Vision Representations
arXiv:2602. 03282v2 Announce Type: replace-cross Abstract: A common assumption in representation learning is that globally well-distributed embeddings support robust and generalizable representations.
arXiv Machine Learning
6d ago
Is a Linear Probe Evidence of a Linear Representation?
arXiv:2610.22655v1 Announce Type: cross Abstract: The linear representation hypothesis holds that pretrained vision models encode generative factors as linearly decodable directions in feature space,...