arXiv Computer Vision By Enzhe Zhao, Marco Fiorucci, Lamberto Ballan

RankAlign: Vision-Language Representation Alignment via Rank Transformation

Read the original on arXiv Computer Vision →

RankAlign introduces a rank-based normalization technique for aligning vision and language representations without cross-modal supervision. By converting within-modality similarity kernels into ordinal relational representations, it preserves the relative ordering of similarities while remaining invariant to strictly increasing reparameterizations. The method offers theoretical guarantees for exact and partial ordinal agreement and shows improved, more stable class-level correspondence recovery across various frozen encoders and datasets, even under label corruption and domain shift.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 24

Mind the Heads: Topological Representation Alignment for Multimodal LLMs

arXiv:2606. 23885v1 Announce Type: cross Abstract: Representation alignment has emerged as an effective approach to improve Multimodal Large Language Models (MLLMs) by regularizing their internal representations toward those of an external vision encoder.

By Davide Caffagni, Alberto Compagnoni, Federico Melis, Sara Sarto, Pier Luigi Dovesi, Mark Granroth-Wilding, Marcella Cornia, Lorenzo Baraldi
arXiv AI
Jul 7

Multi-Way Representation Alignment

arXiv:2602. 06205v2 Announce Type: replace-cross Abstract: The Platonic Representation Hypothesis suggests that independently trained neural networks converge to increasingly similar latent spaces.

By Akshit Achara, Tatiana Gaintseva, Mateo Mahaut, Pritish Chakraborty, Viktor Stenby Johansson, Melih Barsbey, Emanuele Rodol\`a, Donato Crisostomi