The paper introduces a divergence-based similarity function (DSF) for multi-view contrastive learning, representing each set of augmented views as a distribution and measuring similarity via distribution divergence. DSF captures joint structure across all views, outperforming prior pairwise methods on tasks such as kNN classification, linear evaluation, transfer learning, and distribution shift. It also offers greater efficiency and eliminates the need for a temperature hyperparameter, unlike cosine similarity.
By Jaehyoung Jeon, Cheolsu Lim, Myungjoo Kang
Medical vision-language models (VLMs) have shown increasing potential for clinical image interpretation. However, these models still struggle to interpret multi-phenotype lesions whose diagnosis requi...
The paper introduces PureVision, a geometry‑supervised framework for medical vision‑language models that tackles the challenge of interpreting multi‑phenotype lesions. It comprises PureEyes, which imposes geometric constraints to preserve anatomical hierarchies and phenotypic subclass relationships, and PureNeurons, which aggregates lesion‑specific anatomical and phenotypic evidence in a learned latent space. Experiments on LIDC‑IDRI, CBIS‑DDSM, and 3DReasonKnee show that PureVision enhances lesion grounding and phenotype characterization in visual question answering and radiology report generation.
By Hao Wang, Qiwei Zeng, Shuchang Ye, Jinghao Lin, Yuezhe Yang, Yige Peng, Jinman Kim, Lei Bi
arXiv:2504. 16318v3 Announce Type: replace Abstract: Cosine similarity is a standard comparison rule for learned representations in information retrieval, natural language processing, computer vision, and multimodal learning.
By Kisung You
arXiv:2607. 04525v1 Announce Type: cross Abstract: How concepts are represented in neural networks is a fundamental question in machine learning.
By Zhimin Hu, Lanhao Niu, Sashank Varma
arXiv:2606. 30625v1 Announce Type: cross Abstract: Contrastive embedding models trained with scale-invariant losses are typically paired with distance metrics like cosine similarity, effectively ignoring embedding magnitudes.
By Ziwei Su, Junyu Ren, Victor Veitch