arXiv AI
Jul 3
Learning 3D-Gaussian Simulators from RGB Videos
arXiv:2503. 24009v3 Announce Type: replace-cross Abstract: Realistic simulation is critical for applications ranging from robotics to animation.
3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning
arXiv:2606. 19451v1 Announce Type: new Abstract: We introduce 3D-DLP, a self-supervised object-centric representation learning model that decomposes scene-level RGB-D or voxel observations into a set of 3D latent particles.
Related stories
Hugging Face Trending Papers
Aug 6
LAWM-3D: Learning 3D-Aware Latent Actions from Human Videos for Generalizable Robot World Models
World models enable agents to perform forward rollout and planning without real-world interaction. However, their application in open-world embodied intelligence remains limited by the high cost of action annotations and the heterogeneity of action spaces across platforms.
arXiv AI
Jun 15
Vanishing Depth: Training Generalized Depth Adapters with Sinusoidal Depth Preprocessing for Pretrained RGB Encoders
arXiv:2503. 19947v2 Announce Type: replace-cross Abstract: Generalized metric depth understanding is critical for precise vision-guided robotics, which current state-of-the-art (SOTA) vision-encoders do not support.
arXiv AI
Jun 2
Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Latent Priors
arXiv:2411. 17790v3 Announce Type: replace-cross Abstract: Accurate 3D mapping in endoscopy enables quantitative, holistic lesion characterization within the gastrointestinal (GI) tract, requiring reliable depth and pose estimation.
arXiv AI
Jun 9
Latent Diffusion Policy: Shaping Latent Spaces for Diffusion-Based Robotic Manipulation
arXiv:2606. 08657v1 Announce Type: cross Abstract: Diffusion-based visuomotor policies operating directly in raw action spaces conflate scene comprehension with trajectory generation within a single denoising process.
arXiv AI
Jul 28
AutoWorld: Learning Multi-Agent Traffic Simulation with Self-Supervised World Models
arXiv:2603. 28963v2 Announce Type: replace-cross Abstract: Simulation with realistic traffic agents is essential for validating autonomous driving systems.
arXiv AI
Jul 29
SAM3D-Guided Object-Centric Representation Alignment for Vision-Language-Action Models
arXiv:2607. 25912v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have shown strong potential for general robot manipulation, but most existing models rely on 2D visual-language backbones and lack fine-grained 3D understanding of target objects, especially under occlusion, pose variation, scale changes, and precise spatial interaction.
arXiv AI
Jun 9
What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction
arXiv:2606. 07687v1 Announce Type: cross Abstract: Video world models are increasingly used to provide predictive visual representations, yet it remains unclear which pretraining signals induce action-relevant structure in their latent spaces.
arXiv AI
Jun 29
GenMatter: Perceiving Physical Objects with Generative Matter Models
arXiv:2604. 22160v2 Announce Type: replace-cross Abstract: Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation.
arXiv AI
Jun 8
MatterDoor: Sampling Zero-shot Spatio-semantic Priors using Generative Models
arXiv:2510. 11014v2 Announce Type: replace-cross Abstract: Autonomous robots often view rooms only partially, through a doorway, where the walls and scene structure hide the geometry and task-relevant semantics needed for safe navigation and goal-directed action.
arXiv AI
Jul 7
Geometry-Aware Motion Latents for Learning Robust Manipulation Policies
arXiv:2607. 04714v1 Announce Type: cross Abstract: Learning motion latents for robotic manipulation heavily relies on extracting motion patterns from visual sequences, yet effective action abstractions require understanding three-dimensional geometric transformations.
arXiv AI
Jul 24
3D-Aware VLMs with Implicit and Explicit Geometries
arXiv:2607. 21595v1 Announce Type: cross Abstract: Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning.