arXiv AI
Jul 3
Learning 3D-Gaussian Simulators from RGB Videos
arXiv:2503. 24009v3 Announce Type: replace-cross Abstract: Realistic simulation is critical for applications ranging from robotics to animation.
GenMatter: Perceiving Physical Objects with Generative Matter Models
arXiv:2604. 22160v2 Announce Type: replace-cross Abstract: Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation.
Related stories
arXiv AI
Jun 30
MotionAtlas: Detailed Region Captioning for Motion-Centric Videos
arXiv:2606. 29531v1 Announce Type: cross Abstract: We propose MotionAtlas, a system for detailed captioning of motion-centric videos, comprising (1) a dedicated human-annotated benchmark, (2) a scalable, high-quality pipeline to construct training samples, and (3) a family of powerful Video-MLLMs.
arXiv AI
Jun 30
SemDynReg: Semantics-Guided Deformation Regularization for Dynamic 3D Gaussian Splatting
arXiv:2606. 28656v1 Announce Type: cross Abstract: Deformable 3D Gaussian Splatting (3DGS) has emerged as an efficient approach for rendering dynamic scenes in a wide range of 3D applications.
arXiv AI
Jul 7
Generative Semantic Multi-Object Tracking: A Large-Scale Benchmark and an MLLM-Driven Reasoning Framework
arXiv:2601. 06550v3 Announce Type: replace-cross Abstract: Semantic Multi-Object Tracking (SMOT) is evolving from purely geometric localization toward comprehensive video understanding.
arXiv Machine Learning
Jun 19
3D-DLP: Self-Supervised 3D Object-Centric Scene Representation Learning
arXiv:2606. 19451v1 Announce Type: new Abstract: We introduce 3D-DLP, a self-supervised object-centric representation learning model that decomposes scene-level RGB-D or voxel observations into a set of 3D latent particles.
arXiv AI
Jun 30
UniMotion: A Unified Framework for Motion-Text-Vision Understanding and Generation
arXiv:2603. 22282v2 Announce Type: replace-cross Abstract: We present UniMotion, to our knowledge the first unified framework for simultaneous understanding and generation of human motion, natural language, and RGB images within a single architecture.
arXiv AI
Jul 21
STAR: Skeletal Token Alignment and Rearrangement for Interaction Recognition
arXiv:2607. 17342v1 Announce Type: cross Abstract: Understanding physical human-robot and human-human interactions is a challenging yet emerging topic in 3D vision.
arXiv AI
Jul 8
Harnessing Generative Image Models for Training-Free Primitive Shape Abstraction
arXiv:2607. 05568v1 Announce Type: cross Abstract: Representing 3D shapes as compact sets of geometric primitives is fundamental to robotics, simulation, and scene understanding.
arXiv AI
Jul 2
DeWorldSG: Depth-Aware 3D Semantic Scene Graph Generation via World-Model Priors
arXiv:2607. 00889v1 Announce Type: cross Abstract: We present DeWorldSG, a novel framework that generates spatio-temporally robust 3D Semantic Scene Graphs from RGB-D sequences.
Hugging Face Trending Papers
Jul 6
InFlux++: Real and Synthetic Data for Estimating Dynamic Camera Intrinsics
Camera intrinsics are vital for recovering 3D structure from 2D video. However, most 3D algorithms assume fixed intrinsics throughout a video, an assumption that often fails for real-world in-the-wild videos.
arXiv AI
Jun 15
FEMOT: Multi-Object Tracking using Frame and Event Cameras
arXiv:2606. 14094v1 Announce Type: cross Abstract: Conventional RGB cameras have been widely used in multi-object tracking due to their ability to capture rich appearance and semantic information.
arXiv AI
Aug 5
TransVLM: A Vision-Language Framework and Benchmark for Detecting Any Shot Transitions
arXiv:2604. 27975v2 Announce Type: replace-cross Abstract: Traditional Shot Boundary Detection (SBD) inherently struggles with complex transitions by formulating the task around isolated cut points, frequently yielding corrupted video shots.