Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Sparse-view X-ray 3D reconstruction is essential for reducing radiation exposure, but recovering a density field from a handful of X-ray projections is severely ill-posed. Recently, 3D Gaussian Splatt...
Generating a 3D dental volume from a single panoramic radiograph (PXR) could provide a low-radiation alternative to Cone-Beam Computed Tomography (CBCT), but the problem is highly underdetermined: panoramic acquisition integrates 3D attenuation along curved X-ray paths into a 2D image, leaving depth-resolved anatomy unobserved. Existing implicit and generative approaches often produce oversmoothed geometry or anatomically inconsistent hallucinations, lacking geometry-driven supervision and relying on smooth representations unable to precisely localize sharp anatomical boundaries.
FaCT-GS is a new framework that accelerates Gaussian Splatting (GS) for X‑ray Computed Tomography (CT) reconstruction. By optimizing voxelization and rasterization pipelines, it achieves speeds more than four times faster than the current state‑of‑the‑art GS methods on 512×512 projections and over thirteen times faster on 2k projections. The improved voxelization also allows quick fitting of Gaussians to existing volumes, providing a compressed representation or a warm‑start prior for reconstruction.
Sparse-view computed tomography is a severely ill-posed inverse problem, where recent 3D Gaussian Splatting methods offer an efficient explicit representation for tomographic reconstruction. However, we find that projection-domain optimization can be misleading in this setting: the rendered projections may continue to improve while the reconstructed volume deteriorates.
The paper introduces LiftXR, a geometry‑guided framework that first reconstructs a 3D anatomical layout from bi‑planar X‑ray images and then uses this layout to guide CT volume reconstruction. An anatomical parser refines the layout by analyzing the reconstructed CT, enabling region‑specific intensity calibration. Experiments on two public datasets show LiftXR surpasses recent X‑ray‑to‑CT methods and improves downstream segmentation performance.
arXiv:2607. 04661v1 Announce Type: cross Abstract: Reconstructing 3D scene structures from sparse, low-overlap observations remains a fundamental challenge in autonomous driving.