Recent advancements in 3D Gaussian Splatting (3DGS) have enabled language-guided scene understanding. However, existing Referring 3D Gaussian Splatting (R3DGS) methods are fundamentally restricted to single-target queries.
SetCon reformulates open-ended referring segmentation as set-level concept prediction, using LVLM-generated natural-language concepts instead of segmentation-specific tokens. It employs a hierarchical semantic decomposition that first predicts a shared set-level concept and then refines it into fine-grained concept groups aligned with target subsets. The method, supported by a two-stage annotation pipeline adding hierarchical semantic supervision, achieves state-of-the-art results on multiple image and video benchmarks, with performance gains increasing as the number of referred targets grows.
By Zhixiong Zhang, Yizhuo Li, Shuangrui Ding, Yuhang Zang, Shengyuan Ding, Long Xing, Yibin Wang, Qiaosheng Zhang, Jiaqi Wang
The paper introduces R4DGS, a method for referring segmentation in dynamic 4D Gaussian splatting scenes. It presents the R4D-Bench-QA benchmark with structured query annotations and a unified framework called ReferGaussian that converts dynamic Gaussians into language-addressable entities for training‑free inference. Experiments show improved temporal target selection and competitive spatiotemporal grounding without scene‑specific semantic training.
By Bangpu Chen, Yaxuan Li, Shirui Peng, Xiangtian Si, Liuxin Chu, Xitong Cao, Hongbo Jin, Jiayu Ding
The paper examines how rewriting verbose, narrative-style queries into concise keyword‑grounded forms improves complex object segmentation in 4D Gaussian representations. By applying a training‑free reinterpretation strategy, the authors reduce linguistic noise while preserving essential semantic anchors. Experiments on HyperNeRF and Neu3D show that rewritten queries boost temporal accuracy from 60.92% to 92.21% and vIoU from 20.08% to 76.94%, with ablation studies confirming the benefits of shorter, keyword‑focused queries.
By Thanh-Khoi Nguyen, Thien-Phuc Tran, Minh-Triet Tran
arXiv:2610.24452v2 Announce Type: replace-cross
Abstract: We introduce avatar referring segmentation, which selects regions of animatable Gaussian avatars from language queries. A query can also spec...
By Junsu Kim, Naeun Kim, Dongyoon Han, Seungryul Baek
FoRIS is a training‑free in‑context segmentation framework that refines foreground masks through a coarse‑to‑fine process. It operates in three stages—Foreground Purification, Localization, and Consolidation—to suppress background noise, pinpoint target regions, and reconstruct complete foreground structures. The method achieves state‑of‑the‑art performance, improving mIoU by 4.5 and 4.8 points in 1‑shot and 5‑shot settings respectively.
By Ming Hu, Jianfu Yin, Mingyu Dou, Miaomiao Zhang, Yao Wang, Cong Hu, Bingliang Hu, Quan Wang