arXiv AI

LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields

arXiv:2606. 31941v1 Announce Type: cross Abstract: Unstructured navigational features, such as irregular planting or discontinuities, remain the primary failure mode for under-canopy agricultural robots.

arXiv Computer Vision
Oct 8

Geometry-Centered 3D Latent World Models for Growing Surfaces

The paper introduces FOLIAGE, a geometry‑centered latent world model designed for systems that grow and change shape over time. FOLIAGE allocates higher‑resolution state to regions expected to grow while keeping mature areas compact, fusing RGB, point‑cloud, and mesh data into a deployable geometric state and conditioning dynamics on material controls. The authors evaluate the model on new benchmarks (SURF‑GARDEN and SURF‑BENCH) and demonstrate significant reductions in inverse‑material error, mesh forecasting error, and improved cross‑modal retrieval, with robust performance under sensor loss and correspondence corruption.

By Xiaoyi Liu, Hao Tang
arXiv Computer Vision
Sep 28

WALT: Learning World-Model-Aligned Latent Trajectories for Autonomous Driving

WALT introduces a method to align latent trajectories with pretrained driving world models, creating a compact generative trajectory space that preserves action-relevant semantics without altering the original model. The approach uses a dual-branch autoencoder to map raw waypoints into this latent space and transfers visual world knowledge into trajectory representations. Experiments on NAVSIM benchmarks show modest performance gains and a 30.5% reduction in planner FLOPs, indicating that maintaining world representations while extracting action-relevant information can improve trajectory planning efficiency.

By Mingkai Jia, Jiaxin Guo, Zhijian Shu, Jiawei Xu, Mingxiao Li, Jintao Cheng, Ping Tan, Wei Yin
arXiv Computer Vision
3d ago

Reading the Room: Scale-ambiguous Semantic Registration of Sparse VSLAM Maps to Floor Plans in Partially Built Environments

Reading the Room (RR) is a global‑local method that registers scale‑ambiguous, sparse semantic VSLAM maps to partially built floor plans. It introduces a single robust, differentiable, class‑balanced semantic‑geometric energy function that drives all pipeline stages, and offers two global initialization schemes—one using a single user‑provided correspondence and another using a cross‑modal matching network. Evaluated on 33 sequences from three construction sites, RR outperforms classical and learning‑based baselines, improving mean absolute trajectory error by 4.5× overall and 7.6× when an anchor is supplied.

By Bjorn Stragier, Emilia Szyma\'nska, J. Micah Prendergast, Lukas Rosenberger Schmid
arXiv Machine Learning
Sep 11

ObstaDiff: Generalizable Diffusion Policy Learning via Obstacle-aware Representations

ObstaDiff is a diffusion-policy framework that introduces a lightweight obstacle-aware visual encoder to generate structured representations of targets, obstacles, and background. By aligning these representations, the policy produces end-effector trajectories that focus on a target-centered bottleneck pose while accounting for surrounding obstacles. In real-robot greenhouse trials, ObstaDiff achieved a 75.41% task success rate and an 8.20% obstacle collision rate, outperforming existing imitation-learning baselines in cluttered agricultural settings.

By Jiawen Wang, Kevin Yao, Khalid Jawed