Hugging Face Trending Papers

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

Read the original on Hugging Face Trending Papers →

The paper introduces DINO-Med, a patch‑based framework that adapts natural‑image foundation models to multi‑modal medical imaging, specifically for liver fibrosis staging. It processes raw multimodal scans through training‑free registration, automated localization, and mask‑filtered patch extraction, then aggregates patch‑level insights into subject‑level diagnostics. Using the CARE 2025 Liver Track 4 cohort, the DINOv3‑based approach achieved the highest classification accuracy (78.4% for mild fibrosis and 75.8% for cirrhosis) compared to other feature representations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computer Vision
Sep 11

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

DINO-Med introduces a patch‑based framework that adapts natural‑image foundation models, specifically DINOv3, to multi‑modal medical imaging. The method uses training‑free registration, automated localization, and mask‑filtered patch extraction to aggregate patch‑level features into subject‑level diagnostics. In liver fibrosis staging, DINOv3 outperforms handcrafted radiomics, ResNet, and SAM‑Med2D features, achieving 78.4% accuracy for mild fibrosis (S1) and 75.8% for cirrhosis (S4) on the CARE 2025 cohort.

By Boya Wang, Ruizhe Li, Chao Chen, Xin Chen
Hugging Face Trending Papers
Oct 13

LiFUSE: Frequency-Spatial Unified Self-Supervised Pretraining for Liver Disease Analysis on Non-contrast CT

LiFUSE introduces a unified frequency‑spatial self‑supervised pretraining framework for liver disease analysis on non‑contrast CT scans. The method employs a frequency branch that uses random band‑stop masking and spectrum reconstruction, and a spatial branch that performs hybrid‑granularity masked volumetric reconstruction, with a cross‑domain consistency scheme to fuse the two branches. Experiments on three clinical tasks and a public transfer setting demonstrate that LiFUSE consistently outperforms strong baselines, indicating its potential to enhance liver disease screening using low‑contrast NCCT images.

arXiv Computer Vision
Aug 25

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

arXiv:2409.16183v2 Announce Type: replace Abstract: Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in m...

By Xiaohong Liu, Guoxing Yang, Yulin Luo, Jiaji Mao, Xiang Zhang, Haibo Wang, Zhiyang He, Ming Gao, Shanghang Zhang, Jun Shen, Guangyu Wang
arXiv Computer Vision
Oct 12

Multimodal Fusion for Fine-Grained Classification of Breast Fibroadenoma and Phyllodes Tumors

The paper introduces the FAPT-M Dataset, a pathology‑confirmed multimodal collection of 910 breast patients that includes ultrasound images, structured clinical attributes, and diagnostic descriptions. It proposes a clinically guided multimodal framework that fuses DenseNet visual encoding, CLIP‑inspired text encoding, and lightweight clinical encoding, enhanced by clinical‑conditioned adaptive modulation, cross‑modal Transformer fusion, and dual‑path representation learning. The method achieves 77.64% accuracy, 73.38% F1‑score, and 89.74% AUC, outperforming CNN, Transformer, and vision‑language baselines, and demonstrates the value of three‑modality fusion through ablation and class‑balanced studies.

By Chuxi Nan, Di Wu, Hongming Guo, Ning Cao, Xiaohui Zhu, Zhaoting Shi, Jiawei Li