MixPT is a point transformer that combines window and global attention blocks in an interleaved schedule, using a fixed serialization pattern for window blocks. It applies global attention to spatially pooled tokens for large scenes, feeding residual updates back to the original-resolution stream. Experiments on indoor and outdoor benchmarks show MixPT achieves competitive accuracy with lower latency than existing window- or global-attention baselines, and can scale by repeating the interleaved pattern.
By Minkyun Seo, Hyungtae Lim, Jaesik Park
arXiv:2609.23733v1 Announce Type: new
Abstract: Feed-forward visual geometry models such as the Visual Geometry Grounded Transformer (VGGT) have recently enabled direct 3D reconstruction from multi-v...
By Abteen Arab, Guile Wu, Chengjie Huang, Dongfeng Bai
The paper introduces Hardware‑aware Calibrated Clustered Attention (BC attention) to speed up the global attention layers of the Visual Geometry Grounded Transformer (VGGT) used for 3D scene reconstruction. By clustering queries within hardware‑friendly neighborhood blocks and adding hashing hyperplane calibration plus threshold‑based error compensation, BC attention reduces computation and memory traffic, enabling it to handle long sequences with practical latency gains on GPUs. Experiments show that calibrated BC attention accelerates global attention by 2.10–2.63× and the entire backbone by 1.77–2.35×, with only a 1% loss in accuracy, and achieves up to 2.87× latency improvement with less than 5% performance drop.
By Weitian Wang, Shubham Rai, Cecilia De La Parra, Akash Kumar
arXiv:2605.12491v2 Announce Type: replace
Abstract: Vision Transformers (ViTs) learn rich visual-semantic representations through all-to-all self-attention among patch tokens. However, this design im...
By Alan Z. Song, Yinjie Chen, Mu Nan, Deva Ramanan, Michael J. Tarr, Andrew F. Luo
The paper presents a zero‑shot framework for high‑throughput generative video super‑resolution (VSR) that operates on a single high‑end consumer GPU without retraining. It decouples spatial upscaling, handled by a time‑distilled one‑step diffusion backbone, from temporal stabilization, achieved with a lightweight pretrained flow‑based interpolator. A resolution‑aware hybrid attention scheme replaces high‑resolution global attention with neighborhood attention to improve scalability, achieving up to ~32 FPS at 720p and a 44% speedup at 4K on an NVIDIA RTX 4090, while maintaining competitive perceptual quality and temporal consistency on standard VSR benchmarks.
By Georgios Panaretou, Sotirios Chatzis
arXiv:2610.08772v1 Announce Type: new
Abstract: Diffusion Transformers (DiTs) have achieved strong performance in image and video generation, but the quadratic complexity of full attention makes high...
By Liao Ma, Jiayi Song, Yunfeng Wu, Songhua Liu, Peilin Zhao
arXiv:2605.15195v2 Announce Type: replace
Abstract: Recent feed-forward reconstruction models, such as VGGT, have proven competitive with traditional optimization-based reconstructors while also prov...
By Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Sch\"onberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, Christian Rupprecht
The paper introduces IG‑VLA, a vision‑language‑action framework that learns to imagine task‑relevant future scene evolution in a latent spatiotemporal space, guiding action prediction without generating full pixel‑level videos. It further compresses this future reasoning into a compact Scene Gist Token via Scene Gist Memory, enabling efficient inference. Experiments on LIBERO, LIBERO‑Plus, and VLABench show that IG‑VLA improves success rates by nearly 6% and speeds up inference up to 6.38× compared to strong baselines.
By Shenglan Li, Zhendong Mi, Hengyi Zhu, Jingwu Luo, Chun Kit Chan, Geng Yuan, Yanzhi Wang, Pu Zhao, Shaoyi Huang
arXiv:2509.22650v3 Announce Type: replace
Abstract: Most existing approaches to referring segmentation achieve strong performance only through fine-tuning or by composing multiple pre-trained models,...
By Anna Kukleva, Enis Simsar, Alessio Tonioni, Muhammad Ferjad Naeem, Federico Tombari, Jan Eric Lenssen, Bernt Schiele
arXiv:2610.07720v1 Announce Type: cross
Abstract: Multi-reference image generation requires preserving the appearance of multiple subjects while composing them into a coherent scene. However, existin...
By Wanning He, Yuyao Zhang, Yu-Wing Tai
arXiv:2605.14315v2 Announce Type: replace
Abstract: Recent feed-forward 3D reconstruction methods, such as visual geometry transformers, have substantially advanced the traditional per-scene optimiza...
By David Huang, Guile Wu, Chengjie Huang, Bingbing Liu, Dongfeng Bai
BlazeVGGT is a training‑free, plug‑and‑play module that speeds up the VGGT visual geometry model by sparsifying cross‑view attention. It selects a compact set of complementary views using a greedy determinantal point process, preserving dense per‑frame predictions while eliminating redundant computations. On 2,000‑frame sequences, BlazeVGGT achieves roughly 13× faster inference and improves Chamfer Distance from 0.41 to 0.32, demonstrating a strong accuracy–efficiency trade‑off for point‑cloud reconstruction and camera‑pose estimation.
By Shujun Yao, Junhui Lin, Congying Han, Tiande Guo, Ziwen Liu, Bonan Li