arXiv Machine Learning
Sep 24

FFM-CP: Cross-Backbone Fusion of Vision-Language Foundation Models for Few-Shot Computational Pathology

The paper introduces FFM-CP, a framework that fuses multiple pathology vision‑language foundation models for few‑shot learning. It aligns heterogeneous representations with an Orthogonal Procrustes transformation, then uses a unified graph to refine support‑image features and class prototypes across backbones. Experiments on six histopathology datasets show that FFM‑CP outperforms the best single adapted model in 50 of 54 few‑shot comparisons.

By Anh-Tien Nguyen, Trung DQ. Dang, Nghiem Tuong Diep, Bui Ngoc Han Nguyen, Tan-Ha Mai, Miriam Cindy Maurer, Phuong Hoa Nguyen, Thi Thuy Uyen Nguyen, Youngjun Park, Daniel Sonntag, Duy Minh Ho Nguyen, Anne-Christin Hauschild