arXiv AI By Akash Kannan, Kiho Park, Victor Veitch

Anchor Divergence for Semantic Geometry in Contrastive Learning

Read the original on arXiv AI →

The paper introduces Anchor Divergences, a technique that leverages contrastive learning, exponential families, and information geometry to define context‑specific semantic geometries on fixed vector representations. By establishing a correspondence between probability distributions over anchors and Bregman geometries, the method allows the geometry itself to be modeled through the anchor distribution. Experiments on retrieval tasks demonstrate that Anchor Divergences effectively and efficiently capture context‑dependent semantic similarity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 11

Divergence-Based Similarity Function for Multi-View Contrastive Learning

The paper introduces a divergence-based similarity function (DSF) for multi-view contrastive learning, representing each set of augmented views as a distribution and measuring similarity via distribution divergence. DSF captures joint structure across all views, outperforming prior pairwise methods on tasks such as kNN classification, linear evaluation, transfer learning, and distribution shift. It also offers greater efficiency and eliminates the need for a temperature hyperparameter, unlike cosine similarity.

By Jaehyoung Jeon, Cheolsu Lim, Myungjoo Kang
arXiv Computer Vision
Oct 8

Geometry-Supervised Visual Representation Learning for Multi-Phenotype Lesion Interpretation in Medical VLMs

The paper introduces PureVision, a geometry‑supervised framework for medical vision‑language models that tackles the challenge of interpreting multi‑phenotype lesions. It comprises PureEyes, which imposes geometric constraints to preserve anatomical hierarchies and phenotypic subclass relationships, and PureNeurons, which aggregates lesion‑specific anatomical and phenotypic evidence in a learned latent space. Experiments on LIDC‑IDRI, CBIS‑DDSM, and 3DReasonKnee show that PureVision enhances lesion grounding and phenotype characterization in visual question answering and radiology report generation.

By Hao Wang, Qiwei Zeng, Shuchang Ye, Jinghao Lin, Yuezhe Yang, Yige Peng, Jinman Kim, Lei Bi