arXiv AI

InstEditSeg: Instruction-Driven Image Editing for Polyp and Skin Lesion Segmentation

InstEditSeg is a generative framework that treats medical segmentation as an instruction-driven image editing task. Instead of producing binary masks, it renders a color-coded overlay on the original image guided by textual instructions, leveraging latent diffusion models to align with natural image distributions and reduce domain gaps. The method incorporates a DINOv3 visual encoder and a multi-scale feature pyramid fused into the diffusion U‑Net, and uses a dual‑branch classifier‑free guidance strategy to lower inference cost, achieving competitive accuracy on polyp and skin lesion datasets while improving cross‑domain generalization and multi‑lesion segmentation.

arXiv Computer Vision
Sep 11

BruNet: A Cross-Domain Transfer Framework for Bruise Segmentation

BruNet is a new cross‑domain transfer framework for automatic bruise segmentation that combines a ViT‑based visual encoder (either self‑supervised DINOv3 or pretrained LingBot‑Vision) with a SAM‑based mask decoder. The model is trained on the HAM10000 skin lesion dataset and evaluated on a separate bruise dataset without any fine‑tuning, achieving superior performance over CNN‑based models, state‑of‑the‑art segmentation models, ChatGPT‑4o/5‑assisted SAM2 zero‑shot baselines, and the medical‑oriented MedSAM. This work represents the first study to address pixel‑level localisation of bruises, demonstrating strong cross‑domain generalisation.

By Qiming Wang, Richard J. Motley, Ebube E. Obi, Xianfang Sun, Paul L. Rosin
arXiv Machine Learning
Aug 27

Unsupervised Anatomical Feature Learning via Diffusion Models: Enhanced Medical Image Segmentation with Denoising Diffusion Probabilistic Models

The paper introduces an unsupervised approach to medical image segmentation by training a Denoising Diffusion Probabilistic Model (DDPM) on 21 unlabeled abdominal CT scans to learn anatomical features. The encoder weights from the DDPM are transferred to a U‑Net for downstream segmentation on the BTCV multi‑organ dataset, resulting in a significant Dice score improvement for liver segmentation from 0.75 to 0.93. In low‑data regimes, diffusion‑pretrained models retain robust performance, achieving high Dice scores even with only 10% of labeled data.

By Akshat G, Divyansh Gupta, Shaleen Bhatnagar, Shilpa Ankalaki, Tusar Kanti Mishra
arXiv AI
Sep 4

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

The paper introduces FreNet, a feature reconfiguration framework that incorporates visual priors for medical lesion segmentation. FreNet performs pixel‑level reconfiguration before encoding using an Implicit Prior Neural Network (IPNN) that leverages SAM, and feature‑level reconfiguration during encoding via a Dual‑domain Feature Reconfiguration (DFR) module, which includes a Frequency Decoupling Module (FDM) and a Spatial Localization Module (SLM). Experiments on nine benchmarks across three imaging modalities show that FreNet outperforms state‑of‑the‑art methods, achieving a 5.0% Dice improvement over the best baseline on the ETIS dataset and a 7.2% improvement over SAM.

By Yinan Liu, Jiankang Hong, Zhen Gao, Ye Lu
Hugging Face Trending Papers
Sep 3

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation

Feature Reconfiguration With Visual Prior for Medical Lesion Segmentation proposes FreNet, a framework that reconfigures images and features before and during encoding to improve lesion segmentation. It introduces an Implicit Prior Neural Network that uses a visual prior from SAM to suppress background responses, and a Dual-domain Feature Reconfiguration module that decouples features in frequency and spatial domains to better handle diverse lesion morphology. Experiments on nine benchmarks across three imaging modalities show FreNet outperforms state‑of‑the‑art methods, achieving a 5.0% Dice improvement over the best prior method on the ETIS dataset.

arXiv AI
Aug 3

DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation

arXiv:2607. 29337v1 Announce Type: cross Abstract: Background and Objective: Generating realistic medical images with anatomically accurate segmentation masks helps address the shortage of annotated data in medical imaging, particularly in optical coherence tomography (OCT) of mouse eyes, where manual retinal layer delineation is labour-intensive due to tiny structures and required expertise, resulting in scarce datasets.

By Fernando Garc\'ia-Torres, Roc\'io del Amor, Sandra Morales, \'Alvaro Barroso, Peter Heiduschka, Bj\"orn Kemper, Valery Naranjo