Hugging Face Trending Papers

φ-RIE: From Photorealistic Reconstruction to Interactive Environments

arXiv Computer Vision
Sep 15

Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting

Habitat-GS is a navigation-focused embodied AI simulator that extends Habitat‑Sim by incorporating 3D Gaussian Splatting (3DGS) for real‑time photorealistic rendering and scalable asset import. It introduces a Gaussian avatar module that represents dynamic humans as both photorealistic visual entities and navigation obstacles, enabling agents to learn human‑aware behaviors. Experiments show that agents trained on 3DGS scenes generalize better across domains and that the avatar system supports effective human‑aware navigation while maintaining system scalability.

By Ziyuan Xia, Jingyi Xu, Chong Cui, Yuanhong Yu, Jiazhao Zhang, Qingsong Yan, Tao Ni, Junbo Chen, Xiaowei Zhou, Hujun Bao, Ruizhen Hu, Sida Peng
arXiv Machine Learning
Sep 16

The Neverwhere Visual Parkour Benchmark Suite

The paper introduces the Neverwhere Visual Parkour Benchmark Suite, a collection of over sixty hyper‑photo‑realistic 3D Gaussian Splatting reconstructions of urban indoor and outdoor scenes designed to evaluate visual locomotion controllers in closed‑loop, continuous testing setups. It aims to bridge the gap between training and real‑world evaluation by providing reproducible environments and policy checkpoints trained across multiple scenes, while highlighting the risks of relying solely on 3D Gaussian‑generated data. The authors offer code and data on their project page for easy integration into robotic evaluation pipelines.

By Ziyu Chen, Henghui Bao, Haoran Chang, Alan Yu, Ran Choi, Kai McClennen, Gio Huh, Kevin Yang, Ri-Zhao Qiu, Yajvan Ravan, John J. Leonard, Xiaolong Wang, Phillip Isola, Ge Yang, Yue Wang
Hugging Face Trending Papers
Jul 2

Online Segment 3D Gaussians via Launching Virtual Drones

Interactive segmentation of 3D Gaussians offers a compelling opportunity for real-time manipulation of 3D scenes, thanks to the real-time rendering capability of 3D Gaussian Splatting (3DGS). However, existing methods require a time-consuming per-scene setup - typically tens of seconds or even minutes - before interactive segmentation can begin on a raw 3DGS scene.

arXiv Computer Vision
Sep 16

DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding

DGSG-Mind introduces a hybrid instance-aware 3D Gaussian dynamic scene graph system that integrates open‑vocabulary semantic information into dynamic 3D scene representations. By coupling a probabilistic voxel grid with explicit 3D Gaussians, it achieves robust cross‑modal instance fusion, incremental semantic mapping, and dynamic change handling through Gaussian‑based relocalization and masked refinement. The system builds a hierarchical scene graph and a 3D Gaussian Mind for multimodal reasoning, achieving state‑of‑the‑art zero‑shot 3D visual grounding and strong performance in open‑vocabulary semantic segmentation and scene reconstruction, and is demonstrated on real‑world robots.

By Luzhou Ge, Xiangyu Zhu, Jinyan Liu, Xuesong Li
arXiv Computer Vision
Sep 3

InceptionGS: Generative Bootstrapping for Large-Scale Gaussian Splatting under Unstructured View Sampling

InceptionGS is a method that improves large‑scale Gaussian splatting for scenes captured with unstructured view sampling. It starts from an initial Gaussian splatting and selectively repairs areas affected by sparse views by integrating scene‑ and view‑adaptive generative priors, while keeping well‑covered regions unchanged. Experiments on real‑world scenes show that this hybrid reconstruction‑generation approach yields higher‑fidelity results than existing methods.

By Tianheng Lu, Guangyu Wang, Ruqi Huang, Lu Fang