arXiv Computer Vision

Sonicmesh: Enhancing 3D Human Mesh Reconstruction in Vision-Impaired Environments With Acoustic Signals

arXiv Computer Vision
Sep 11

UBone3D: Physics-Rectified Conditional Flow Matching for Anatomical 3D Shape Completion from Ultrasound

UBone3D is a new framework that completes 3D anatomical shapes from partial ultrasound point clouds using physics-rectified conditional flow matching. It models ultrasound artifacts with a simulated physics proxy and applies test-time physics rectification to guide the completion. The method combines a CT-trained generative shape prior and a physics consistency network, achieving higher reconstruction accuracy and anatomical fidelity than existing baselines.

By Weiying Chen, Yuchong Gao, Siyuan Li, Marek Reformat, Rui Zheng, Edmond Lou
arXiv Computer Vision
5d ago

UltraDiff: Differentiable Ray Tracing in Ultrasound for Shape Optimization

UltraDiff is a modular framework that extends differentiable rendering to medical ultrasound by modeling image formation as a path‑space integral gated by travel time. It derives a Monte Carlo estimator for both the forward ultrasound model and its gradients, enabling gradient‑based optimization of scene parameters. The authors demonstrate the method on inverse geometry estimation, recovering vertebral surfaces from simulated and real B‑mode sweeps without requiring pre‑segmented images, achieving competitive geometric accuracy.

By Felix Duelmer, Magdalena Wysocki, Nassir Navab, Mohammad Farid Azampour
arXiv AI
5d ago

Local2Mesh: Spatially Localized Contour-to-Mesh for Left Ventricular Reconstruction from Sparse 2D Cardiac MRI

Local2Mesh is a spatially localized contour‑to‑mesh framework that reconstructs 3‑D left ventricular geometry from sparse 2‑D cardiac MRI contours without requiring 3‑D mesh annotations. It corrects inter‑slice misalignment through geometry‑aware alignment and routes contour features to template vertices via a plane‑aware Local Router, then jointly uses local and global features to deform a template mesh. Experiments on M&Ms‑2 and ACDC datasets show superior geometric reconstruction, functional estimation, and disease classification compared to existing methods, with strong cross‑dataset generalization.

By Haoyu Wu, Ling Lin, Pascal Lef\`evre, Ruizhe Li, Xiaowu Sun
arXiv Computer Vision
Aug 27

UltraPIPS: Improving model perception in B-mode ultrasound with foundation models

UltraPIPS introduces domain‑specific foundation models for measuring perceptual similarity in B‑mode ultrasound images. The study shows that ultrasound‑trained LPIPS backbones better correlate with downstream tasks such as classification, segmentation, and reconstruction than natural‑image or general medical models. Optimizing LPIPS loss with an ultrasound backbone yields a strong balance between reconstruction quality and realism, and the authors provide an open‑source library for these metrics.

By Tal Grutman, Tali Ilovitsh
arXiv Computer Vision
Sep 15

DTI-Guided Volumetric Spherical Harmonics Regression for Single-to-Multi-Shell dMRI Synthesis

arXiv:2609.14312v1 Announce Type: new Abstract: Multi-shell diffusion MRI (dMRI) unlocks more expressive microstructural modeling than single-shell scans, yet its longer acquisition time hinders depl...

By Binghua Li, Christina Andica, Tong Liang, Ziqing Chang, Chao Li, Wataru Uchida, Kaito Takabayashi, Qibin Zhao, Toshihisa Tanaka, Zhe Sun, Shigeki Aoki
arXiv Computer Vision
Aug 28

Reconstructing Humans and Objects in Interaction using Large Reconstruction Models

The paper introduces MILO, a framework that uses Large Reconstruction Models (LRMs) to reconstruct detailed 3D human‑object interactions from a single image. By treating the LRM mesh as a geometric scaffold, MILO segments it into human and object parts, fits a parametric body model to the human component, and optionally aligns an object template to the object component. The approach achieves higher reconstruction accuracy than existing baselines across multiple benchmarks and interaction scenarios.

By Agniv Chatterjee, Georgios Pavlakos