arXiv Machine Learning
Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learning
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 30
SOTAlign: Semi-Supervised Alignment of Unimodal Vision and Language Models via Optimal Transport
arXiv:2602. 23353v2 Announce Type: replace-cross Abstract: The Platonic Representation Hypothesis posits that neural networks trained on different modalities converge toward a shared statistical model of the world.
arXiv AI
Jun 24
Mind the Heads: Topological Representation Alignment for Multimodal LLMs
arXiv:2606. 23885v1 Announce Type: cross Abstract: Representation alignment has emerged as an effective approach to improve Multimodal Large Language Models (MLLMs) by regularizing their internal representations toward those of an external vision encoder.
arXiv Computer Vision
Oct 26
Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models
The paper introduces AURORA, a hyperbolic vision‑language framework that separates angular alignment from radial ordering. Angular alignment captures semantic similarity while a novel Radial‑Angular Order Cone (RAOC) models hierarchical entailment based on parent‑child radial gaps. The approach includes norm regularization to prevent radial degeneration and is evaluated on large image‑text datasets, outperforming both Euclidean and hyperbolic baselines in zero‑shot classification, retrieval, hierarchical reasoning, and compositional understanding.
arXiv AI
Jun 30
Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation
arXiv:2606. 29464v1 Announce Type: cross Abstract: Vision-language dataset distillation (VLDD) compresses a large image-text paired dataset into a small set of synthetic pairs that can efficiently train contrastive vision-language models under strict data and compute budgets.
arXiv Computer Vision
Oct 23
RankAlign: Vision-Language Representation Alignment via Rank Transformation
RankAlign introduces a rank-based normalization technique for aligning vision and language representations without cross-modal supervision. By converting within-modality similarity kernels into ordinal relational representations, it preserves the relative ordering of similarities while remaining invariant to strictly increasing reparameterizations. The method offers theoretical guarantees for exact and partial ordinal agreement and shows improved, more stable class-level correspondence recovery across various frozen encoders and datasets, even under label corruption and domain shift.
arXiv AI
Oct 5
Revisiting Visual Representation Enhancement of VLMs via Kernel Canonical Correlation Analysis
arXiv:2610.02718v1 Announce Type: cross Abstract: Vision-language models such as CLIP exhibit strong semantic generalization, but remain limited in fine-grained visual perception. A recent work named...