arXiv Computer Vision

Spherical Geometry-Aware Panoptic Scene Graph Generation for Equirectangular Panoramas

arXiv Computer Vision
Oct 16

GeoPano: Towards Geometrically Accurate 3D Reconstruction from a Single Panorama

GeoPano is a feed‑forward framework that reconstructs geometrically accurate 3D point clouds from a single panoramic image. It introduces a panoramic‑aware attention aggregator with a novel Pano‑Attention mechanism to exploit spherical geometry and reduce cross‑view inconsistencies. A hybrid supervision strategy enforces both fine‑grained local detail in perspective views and global structural coherence in spherical space, leading to superior reconstruction accuracy, consistency, and visual fidelity compared to prior state‑of‑the‑art methods.

By Jing OU, Zidong Cao, Liaoyuan Fan, Zhuoxiao Li, Shuai Zhang, Yinrui Ren, Dongli Wu, Haoang Li, Hui Xiong, Wufan Zhao
arXiv Computer Vision
Oct 23

Squaring-the-Sphere: Distortion-Free and Seamless Panorama Generation via CubeAtlas

Squaring-the-Sphere introduces CubeAtlas, a new panoramic representation that unifies all cubemap faces into a single canvas, preserving perspective geometry while enabling seamless panorama assembly. The framework leverages a pretrained diffusion transformer with a layout‑aware sparse attention mask to reduce irrelevant token interactions, achieving higher quality than equirectangular projection with lower computational cost. Additionally, a training‑free super‑resolution and fusion scheme enhances fine details before converting to a final ERP panorama, resulting in improved geometric fidelity, cross‑view consistency, and high‑resolution visual quality across benchmarks.

By Xuhui Zuo, Chenjie Cao, Tengfei Wang, Junta Wu, Yisu Zhang, Chunchao Guo
arXiv Computer Vision
Oct 9

Learning Projection-Aware 360-Degree Image Rectification via Dual-Projection Fusion

The paper introduces a dual‑projection framework for rectifying 360° panoramic images, combining a convolutional neural network that processes equirectangular projections with a vision transformer that handles cubemap projections. Cross‑projection feature transformation and multi‑level fusion allow the two representations to interact, supporting collaborative inclination estimation and upright panorama generation. Experiments on SUN360 and M3D demonstrate significant accuracy gains, achieving 65.9% and 85.2% within a 1° error threshold and low Fréchet Inception Distance scores.

By Yuhao Shan, Qianyi Yuan, Jingguo Liu, Shigang Li, Jianfeng Li, Tong Chen
arXiv AI
Oct 2

RelationVGGT: Visual Geometry Transformers for 3D Spatial Relation Segmentation

The paper introduces RelationVGGT, a feed‑forward framework that performs 3D spatial relation segmentation without per‑scene optimization or known camera poses. It combines semantic features from a visual foundation model with geometry‑aware representations from a 3D geometry foundation model, and uses a relation transformer to predict subject‑conditioned, cross‑view relations based on a visual subject and a textual query. The authors also present an automated annotation pipeline built on ScanNet++ with VLMs and LLMs to generate scalable training data for this new task.

By Minsu Kim, Jaesung Choe, Jiwoo Lee, Yu-Chiang Frank Wang, Seon Joo Kim
arXiv Computer Vision
Aug 27

TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detection

TDFNet introduces a Tri-projection Deformable Fusion Network that uses equirectangular, cube map, and tangent projections to mitigate geometric distortions in panoramic salient object detection. It incorporates a cross-projection deformable attention module for geometry-aware sampling and a latitude-guided fusion module that balances ERP and CMP features using spherical latitude priors. The network’s three-branch encoding preserves global continuity, local detail, and boundary precision, improving detection performance over existing projection-based methods.

By Qiangqiang Zhou, Jiacong Yu, Jiawei Xu, Yong Chen, Xin Huang, Ping Li
arXiv Machine Learning
Sep 3

Linear Fusion MultiDiffusion for Fast Training-Free Spherical Panorama Generation

LF-MultiDiffusion is a training‑free method for generating spherical panoramas that extends MultiDiffusion by adding linear projections between target and reference image spaces. It reformulates latent aggregation as a regularized least‑squares problem and solves it with a Krylov‑based iterative solver during denoising, enabling denser and more natural mappings. The approach reduces the number of generator evaluations, improves inference speed by 15.36×, and yields better visual quality, text alignment, and panoramic consistency compared to the strongest training‑free baseline.

By Akio Hayakawa, Yusuke Mukuta, Tatsuya Harada