arXiv Machine Learning

Deformable State Estimation for Autonomous Surgical Tissue Retraction Under Partial Observability

arXiv:2607. 13475v1 Announce Type: cross Abstract: Surgical tissue retraction requires effective manipulation planning under partial and noisy perception.

arXiv Computer Vision
Sep 16

Differentiable Mesh State Estimation via Factor Graph Inference for Deformable Object Reconstruction

arXiv:2609.16686v1 Announce Type: cross Abstract: Estimating deformable object states remains a fundamental challenge in robotics and simulation. We propose a novel factor graph-based framework for p...

By Lidia Al-Zogbi, Fangjie Li, Samuel Tobin, James Ferguson, Nithesh Kumar, Alejandro Chara, Kuan-I Chung, Mingxing Rao, Ayberk Acar, Susheela Sharma Stern, Robert Webster, Daniel Moyer, Alan Kuntz, Caleb Rucker, Tucker Hermans, Jie Ying Wu
arXiv AI
Jul 21

Vis2Reg: Visibility-Aware Landmark-Free Geometric 3D--2D Registration for Liver Laparoscopy

arXiv:2607. 17810v1 Announce Type: cross Abstract: Accurate 3D--2D liver registration, which aligns preoperative 3D models to partial, view-dependent intraoperative surface observations, is critical for AR-guided laparoscopic surgery but remains challenging due to severe occlusion, limited visibility, and the lack of 3D ground-truth supervision.

By Jiaming Feng, Xukun Zhang, Shahid Farid, Sharib Ali
arXiv Computer Vision
6d ago

PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation

The paper introduces PICO, an end-to-end trainable model for 6DoF surgical tool pose estimation that uses multi-task learning to predict segmentation, depth, and pose parameters. It incorporates two geometry-aware proxy tasks—a projection loss and a point-to-point loss—to enforce consistency in 2D and 3D spaces, improving accuracy and robustness. Evaluated on the SurgRIPE dataset, PICO achieves strong performance, ranking second in rotation accuracy and maintaining competitive translation results, especially under occlusion.

By Lucy Fothergill, Pietro Valdastri, Dominic Jones, Duygu Sarikaya
arXiv AI
Jul 7

SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Space

arXiv:2603. 26720v3 Announce Type: replace-cross Abstract: Predicting surgical needle trajectories from endoscopic video is critical for robot-assisted suturing, enabling anticipatory planning, real-time guidance, and safer motion execution.

By Huanrong Liu, Chunlin Tian, Tongyu Jia, Tailai Zhou, Qin Liu, Yu Gao, Yutong Ban, Yun Gu, Guy Rosman, Xin Ma, Qingbiao Li
arXiv AI
Aug 24

Generalizing Soft Tissue Deformation and Force Prediction Across Material Stiffness and Geometry

The paper presents a method for accurately simulating soft tissue deformation and predicting forces across varying material stiffnesses and geometries. It calibrates hyperelastic constitutive models in the SOFA Framework using gravity‑loaded silicone beams, then trains a softness‑conditioned equivariant graph neural network on the calibrated simulations. The resulting model achieves sub‑millimeter deformation accuracy with 0.010 s inference time, and demonstrates that force prediction quality depends on consistent upstream calibration.

By Madina Kojanazarova, Sidaty El Hadramy, Philippe C. Cattin