arXiv Machine Learning By Jaehyoung Jeon, Cheolsu Lim, Myungjoo Kang

Divergence-Based Similarity Function for Multi-View Contrastive Learning

Read the original on arXiv Machine Learning →

The paper introduces a divergence-based similarity function (DSF) for multi-view contrastive learning, representing each set of augmented views as a distribution and measuring similarity via distribution divergence. DSF captures joint structure across all views, outperforming prior pairwise methods on tasks such as kNN classification, linear evaluation, transfer learning, and distribution shift. It also offers greater efficiency and eliminates the need for a temperature hyperparameter, unlike cosine similarity.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 7

Anchor Divergence for Semantic Geometry in Contrastive Learning

The paper introduces Anchor Divergences, a technique that leverages contrastive learning, exponential families, and information geometry to define context‑specific semantic geometries on fixed vector representations. By establishing a correspondence between probability distributions over anchors and Bregman geometries, the method allows the geometry itself to be modeled through the anchor distribution. Experiments on retrieval tasks demonstrate that Anchor Divergences effectively and efficiently capture context‑dependent semantic similarity.

By Akash Kannan, Kiho Park, Victor Veitch
arXiv AI
Oct 26

Rethinking Representation Geometry in Supervised Contrastive Learning under Long-Tailed Data

The paper investigates whether supervised contrastive learning objectives produce a regular simplex geometry in representation space when trained on long‑tailed data. It shows that existing objectives fail to achieve this geometry because they depend on class sample counts. The authors propose a fully balanced contrastive objective that provably forms a regular simplex, leading to a more balanced representation space and improved performance on long‑tailed recognition and transfer learning tasks.

By Joonhyeok Jeong, Jy-yong Sohn, Kibok Lee
arXiv Computer Vision
Sep 11

Prototype Matters: Modality-unified Prototype Self-distillation for Unsupervised Visible-infrared Person Re-identification

The paper introduces a new framework for unsupervised visible‑infrared person re‑identification that leverages modality‑unified prototypes. By contrasting with prototypes that unify both modalities, the method jointly optimizes similarity within and across modalities, improving modality invariance. A self‑distillation step refines instance‑prototype relationships using a steady teacher, resulting in a simple yet effective model validated on standard VI‑ReID benchmarks.

By Menglin Wang, Xiaojin Gong