arXiv Computer Vision

Partition-Invariant Tuning for 3D Scene Understanding

The paper introduces PointPiT, a partition‑invariant tuning framework designed for scene‑level point cloud understanding. It combines a Scene‑aware Structural Adapter (SSA) that fuses local geometry with global context, and Gradient Subspace Optimization (GSO) that selects stable update directions to reduce partition‑induced representation shifts. Experiments on multiple benchmarks show that PointPiT matches or surpasses full fine‑tuning while using less than 1% of the backbone’s parameters, achieving state‑of‑the‑art performance among parameter‑efficient fine‑tuning methods.

arXiv Computer Vision
Sep 18

GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model

GAPrompt++ is a multi-granular geometry-aware prompting method designed to adapt pre-trained 3D vision models to downstream tasks efficiently. It introduces a Point Shift Prompter for multi-scale geometric feature extraction, a Keypoint Prompter for local geometric saliency, and a Prompt Propagation mechanism to embed these cues throughout the model hierarchy. Experiments demonstrate that GAPrompt++ outperforms other prompting-based PEFT methods and even surpasses full fine-tuning while using less than 2% trainable parameters, and the authors provide two new challenging benchmarks for future research.

By Zixiang Ai, Zhenyu Cui, Yufei Guo, Wenwen Qiang, Lei Chen, Jiwen Lu, Jiahuan Zhou
arXiv Computer Vision
Oct 22

Register Anything Model for Generalizable and Robust Point Cloud Registration

The paper introduces the Register Anything Model (RAM), a unified approach for 3D point cloud registration that can robustly estimate 6‑DoF transformations across a wide range of domains, including indoor, outdoor, and object scenes. RAM overcomes domain‑specific challenges by employing a geometry‑aware normalization that voxelizes and standardizes point clouds based on their geometric properties, followed by a hierarchical coarse‑to‑fine pipeline with a geometric transformer that focuses on local consistency. Experiments on 12 benchmarks show that RAM achieves state‑of‑the‑art inlier ratios and registration recall, outperforming methods trained on individual domains and demonstrating strong generalization.

By Zheng Qin, Junhua Xi, Yan Huang, Jiahong Lai, Anwen Huang, Qiong Li, Guangda Zhang, Kai Xu
arXiv Computer Vision
Sep 3

PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

PointGauss is a 3D-native framework that performs semantic parsing and instance segmentation on 3D Gaussian splatting representations by treating Gaussian primitives as unstructured point sets and extracting scale‑invariant geometric features with Point Transformer V3. It introduces an adaptive region‑of‑interest cropping strategy and an instance‑aware distance‑constrained rasterization pipeline to enable scalable, view‑consistent pixel‑level projections. The authors also release SplatSeg‑360, a cross‑scale benchmark with 32 complex scenes and over 6,300 aligned 2D‑3D masks, and show that PointGauss achieves real‑time performance with state‑of‑the‑art 3D‑mIoU (~90%) and 2D‑mIoU (~80%) scores.

By Wentao Sun, Yiping Chen, John S. Zelek, Jonathan Li
arXiv Computer Vision
Oct 23

MixPT: Point Transformer with Interleaved Window and Global Attention

MixPT is a point transformer that combines window and global attention blocks in an interleaved schedule, using a fixed serialization pattern for window blocks. It applies global attention to spatially pooled tokens for large scenes, feeding residual updates back to the original-resolution stream. Experiments on indoor and outdoor benchmarks show MixPT achieves competitive accuracy with lower latency than existing window- or global-attention baselines, and can scale by repeating the interleaved pattern.

By Minkyun Seo, Hyungtae Lim, Jaesik Park
arXiv Computer Vision
Oct 22

LitePT: Lighter Yet Stronger Point Transformer

LitePT introduces a lighter yet stronger 3D point cloud backbone that strategically uses convolutional layers in early, high‑resolution stages and switches to attention in deeper, low‑resolution layers. By adding a novel, parameter‑free 3D positional encoding called PointROPE, LitePT preserves spatial layout while reducing redundancy. The resulting model has 3.6× fewer parameters, runs twice as fast, and uses half the memory of the state‑of‑the‑art Point Transformer V3, yet matches or surpasses its performance across multiple tasks and datasets.

By Yuanwen Yue, Damien Robert, Jianyuan Wang, Sunghwan Hong, Jan Dirk Wegner, Christian Rupprecht, Konrad Schindler
Hugging Face Trending Papers
Oct 22

MixPT: Point Transformer with Interleaved Window and Global Attention

MixPT is a point cloud transformer that interleaves window and global attention blocks while keeping a fixed window serialization pattern. It applies global attention to pooled tokens for large scenes, feeding residual updates back to the full-resolution stream. Experiments on indoor and outdoor benchmarks show MixPT matches or exceeds the accuracy of existing window or global attention models while achieving lower latency, and it can be scaled by repeating the interleaved pattern.

arXiv Computer Vision
Oct 21

HERMES++: Toward a Unified Driving World Model for 3D Scene Understanding and Generation

HERMES++ is a unified driving world model that simultaneously performs 3D scene understanding and future geometry prediction. It uses a BEV representation to merge multi‑view spatial data for LLM compatibility, introduces LLM‑enhanced world queries for knowledge transfer, and employs a Current‑to‑Future Link to condition future geometry on semantic context. A Joint Geometric Optimization strategy enforces structural integrity by combining explicit geometric constraints with implicit latent regularization, and extensive benchmark tests show that HERMES++ outperforms specialist methods in both point cloud prediction and scene understanding.

By Xin Zhou, Dingkang Liang, Xiwu Chen, Feiyang Tan, Dingyuan Zhang, Hengshuang Zhao, Xiang Bai