Hugging Face Blog

Waypoint-1.5: Higher-Fidelity Interactive Worlds for Everyday GPUs

arXiv Computer Vision
6d ago

Waypoint-1.5: A Real-Time Video World Model for Consumer Hardware

Waypoint‑1.5 is a real‑time diffusion world model designed for interactive video generation on consumer‑grade hardware. It is pre‑trained on 100,000 hours of control‑aligned video game footage and can generate playable video conditioned on full keyboard and mouse input. The system offers two resolution variants, distinguishes rendered FPS, latent FPS, and control rate, and includes a detailed data pipeline, architecture, training methodology, and runtime system.

By Rajit Rajpal, Shahbuland Matiana, Liew Wei Pyn, Anmol Agarwal, Ryan Craig, Andrew Lapp, Mithun Hunsur, Sami BuGhanem, Scottie Fox, Aaron Sanders Carson Poole, Irene Park, Dave Rossi, Spencer Frazier, Louis Castricato
arXiv AI
Sep 10

From Splats to Silicon: Rethinking Computational Efficiency of 3DGS

arXiv:2609.06157v1 Announce Type: cross Abstract: 3D Gaussian splatting (3DGS) represents scenes with explicit primitives and supports real-time novel-view synthesis, yet its system efficiency varies...

By Minnan Pei, Qiwei Dong, Yihan Zhou, Gang Li, Yuchen Zhu, Wenju Zhao, Zhongtian Long, Siting Wang, Peisong Wang, Jian Cheng
Hugging Face Trending Papers
Jun 17

Splaxel: Efficient Distributed Training of 3D Gaussian Splatting for Large-scale Scene Reconstruction via Pixel-level Communication

3D Gaussian Splatting (3DGS) enables high-fidelity and real-time 3D scene reconstruction, but scaling training to large-scale scenes requires optimizing hundreds of millions of Gaussians across multiple GPUs. Existing distributed approaches either partition scenes into isolated regions, causing global inconsistency, or rely on global Gaussian-level exchanges, which lead to substantial growth in inter-GPU communication and quickly dominate iteration time.

arXiv Computer Vision
Sep 15

Habitat-GS: A High-Fidelity Navigation Simulator with Dynamic Gaussian Splatting

Habitat-GS is a navigation-focused embodied AI simulator that extends Habitat‑Sim by incorporating 3D Gaussian Splatting (3DGS) for real‑time photorealistic rendering and scalable asset import. It introduces a Gaussian avatar module that represents dynamic humans as both photorealistic visual entities and navigation obstacles, enabling agents to learn human‑aware behaviors. Experiments show that agents trained on 3DGS scenes generalize better across domains and that the avatar system supports effective human‑aware navigation while maintaining system scalability.

By Ziyuan Xia, Jingyi Xu, Chong Cui, Yuanhong Yu, Jiazhao Zhang, Qingsong Yan, Tao Ni, Junbo Chen, Xiaowei Zhou, Hujun Bao, Ruizhen Hu, Sida Peng
arXiv Computer Vision
1d ago

Windfoil: Closed-Form Coverage for Real-Time and Differentiable Vector Graphics

Windfoil is a GPU-friendly algorithm that unifies rasterisation and differentiable vector graphics by evaluating the box-filtered winding number of quadratic Bézier contours in closed form. Implemented in WebGPU, it runs across diverse environments—from web browsers on consumer laptops to high-resolution print media—and supports real-time 2D rendering, high‑resolution rasterisation, and differentiable rendering. Compared to production engines like Skia and game‑oriented rasterisers such as Slug, Windfoil achieves closer fidelity to a reference coverage while maintaining comparable performance, and it outperforms DiffVG and Bézier Splatting in reconstruction quality at a fraction of the per‑step cost, scaling to tens of thousands of shapes at interactive rates.

By Matt DesLauriers
arXiv Computer Vision
Aug 28

Magpie: Real-Time World Renderer for Interactive Games

Magpie is a real‑time generative world‑rendering system designed for interactive games. It decouples gameplay execution from visual generation, allowing designers to define scenes and rules in a game engine while a separate render server produces visual output from the engine’s white‑box frames. This approach preserves gameplay designability and reproducibility, and reduces early prototype dependence on finished visual assets.

By Xiaoyu Zhan, Xinyu Wang, Xiaohong Zhang, Huanjie Zhu, Tengjiao Sun, Pengcheng Fang, Jiaxing Yu, Yanwen Guo, Dongjie Fu
arXiv Machine Learning
Jun 16

STAR-NT: Spatiotemporal Acceleration of Real-Time Neural Transparency Rendering

arXiv:2606. 16747v1 Announce Type: cross Abstract: Neural order-independent transparency delivers high-quality rendering of overlapping transparent surfaces, but its geometry passes and network input generation remain costly, particularly on mobile and legacy hardware.

By Grigoris Tsopouridis, Christos Georgiou-Mousses, Aris Panagiotidis, Andreas Vasilakis, David Corrigan, Tobias A. Franke, Aleksei Gorbonosov, Andrei Astapov, Ioannis Fudos
arXiv Computer Vision
Aug 28

CGS-SLAM: Collaborative Gaussian Splatting based SLAM for Multi-Agent Reconstruction

CGS‑SLAM is a hybrid decentralized/centralized SLAM system that enables multi‑agent 3D Gaussian Splatting reconstruction using only RGB images and inertial data. Each agent locally tracks motion with inertial priors, builds a scaled map via a monocular depth estimator, and shares keyframe encodings to facilitate dynamic keyframing and submap alignment. A central server then aligns submaps with a view‑alignment model, keeping communication costs low while achieving competitive tracking, higher rendering quality, and accurate submap alignment in GNSS‑denied environments.

By Jean-Daniel de Ambrogi, Aladine Chetouani, Vincent Nguyen, Aur\'elien Chateigner