arXiv Computer Vision

SPLATIFY: Reproduce, Discover, Innovate! From Papers and Ideas to Trainable 3DGS Code

arXiv Computer Vision
3d ago

SplatLab: Autonomous Scientific Discovery for 3DGS Research

SplatLab is an autonomous research system designed for 3D Gaussian Splatting (3DGS) that can reproduce published baselines, propose extensions, train models, and generate manuscripts with traceable results. It uses a verified-reproduction backbone, a cascade-weighted Elo tournament for candidate evaluation, a standing falsifier for stress‑test survival, and a seven‑category 3DGS taxonomy to ensure reproducibility and transferability. In PSNR‑targeted experiments, SplatLab’s manuscripts outperform their reproduced baselines by up to +3.78 dB, compressing the research cycle from months to days of autonomous compute.

By Seemandhar Jain, Manmohan Chandraker
arXiv AI
Oct 16

3DCodeVerse: Exploring 3D Worlds as Code

The paper introduces 3DCodeVerse, a research ecosystem that allows coding agents to generate editable and verifiable 3D content at scale. It comprises a large curated dataset of 3D executable code (3DCodeVerse‑2M), a multi‑agent harness that automatically evaluates and refines generated programs using execution checks and spatial measurements, and empirical studies that establish baselines and practical guidance for 3D coding. Experiments show that fine‑tuning on the dataset improves open‑source models’ 3D coding abilities, and the harness outperforms Claude Design in pairwise human evaluations when used with Claude Opus 5.5.

By Yipeng Gao, Ziyao Zeng, Jinfa Huang, Yijiang Li, Haolin Xiong, Wang Qin, Xinlei Yu, Youheng Yao, Jie Zhang, Kun-Yu Lin, Rong Liu, Yinyuan Zhao, Yajie Zhao, Meiqi Guo, Jiebo Luo, Lei Shu, Yunhao Ge, Xinyu Hu, Laurent Itti
arXiv Computer Vision
4d ago

Unfolding 3D Gaussian Splatting via Iterative Gaussian Synopsis

The paper introduces Iterative Gaussian Synopsis, a top‑down unfolding framework that generates compact, progressive levels of detail for 3D Gaussian Splatting (3DGS). Starting from a full‑resolution 3DGS model, it iteratively prunes Gaussian primitives using a learnable mask, building a multi‑level hierarchy that preserves visual quality while reducing storage. The method combines hierarchical spatial grids with a shared Anchor Codebook to capture global structure and local details, enabling efficient, level‑specific rendering with minimal data overhead.

By Yuqin Lu, Yihua Dai, Yang Zhou, Guiqing Li, Shengfeng He
arXiv Computer Vision
Aug 28

Procedura: Agentic 3D Modeling with Procedural Control

Procedura is a new 3D modeling agent that treats 3D shape as code, using a large language model to generate a procedural assembly from a text prompt. It constructs an assembly graph, writes a parametric program with named parts and typed mates, and verifies each part through compile, mate, and connectivity checks before adding it. A vision critic refines the assembly step‑by‑step, and the resulting program includes per‑part materials and simulator‑validated articulation, producing sharp edges and editable, part‑structured outputs that outperform existing native 3D generators on P3D‑Bench and MechBench‑36.

By Youtian Lin, Yikang Yang, Zhanpeng Hu, Mengqi Zhou, Feihu Zhang, Xun Cao, Jiaheng Liu, Yao Yao
arXiv Computer Vision
Sep 24

Fusion-Aware Direct 3D Gaussian Generation with Structured Patch Latent Flows

The paper introduces a fusion‑aware hierarchical Gaussian patch representation that enables direct class‑guided generation of 3D Gaussian Splatting (3DGS) objects. By decomposing irregular Gaussian sets into canonical local patches and encoding them as structured tokens, the method fuses global class semantics with patch‑level geometry, appearance, spatial correspondence, and rendering‑sensitive cues. A structure‑aware rectified flow model, conditioned on patch positions and coupled with global‑local velocity prediction and density‑aware weighting, produces class‑conditioned 3DGS objects within seconds, achieving more coherent geometry, sharper local details, and better multi‑view consistency than baseline models.

By Yizhao Wang, Jingbo Wang, Guantao Zhang
Hugging Face Trending Papers
Aug 3

StreamSplat: Streaming Feed-Forward 3D Gaussian Splatting

Feed-forward 3D Gaussian Splatting enables efficient novel-view synthesis without per-scene optimization, but most existing methods assume a fixed set of context views and process them jointly. This limits their applicability to online scenarios where calibrated views arrive sequentially and the scene must be updated causally.

arXiv AI
Sep 30

Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes

Code4Scene is a benchmark that evaluates coding agents on constructing and editing 3D scenes in Unreal Engine. It tests agents on two tasks: construction, where they must build a scene from open‑ended language, and editing, where they must recover a target scene from reference images while preserving everything else. The benchmark measures task fulfillment, artifact integrity, and physical validity, revealing that construction and editing performance are correlated but not interchangeable, with agents struggling most with spatial composition and precise edits.

By Xiaokang Ye, Siddhant Hitesh Mantri, Zimeng Chen, Edward Zhang, Zhaoxu Zheng, Yuanheng Li, Yizhao Chen, Tianyang Huang, Lianhui Qin
arXiv Computer Vision
Oct 19

RAP: A Dataset for Paper-to-Poster Generation via Declarative Markup from Human-Crafted Exemplars

RAP (Reconstruct A Poster) is a new dataset and benchmark for generating conference posters from research papers, comprising over 25,000 verified paper‑poster pairs from 2022‑2026. Each pair is annotated with a three‑level content taxonomy and converted into styled HTML/CSS markup through an automated derendering pipeline, enabling objective render‑and‑compare evaluation. The corpus supports both inference and training, with a retrieval‑based PosterRAG pipeline and a supervised‑fine‑tuned model, and is publicly available via an online demo.

By Haonan Han, Yukang Lin, Minliang Lin, Haoxian Tan, Jun-Yan He, Rui Yang, Zhi-Qi Cheng, Jie Hu, Guanglu Wan, Xiu Li