arXiv Machine Learning By Julie Mordacq, Vicky Kalogeiton, Steve Oudot

IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension

Read the original on arXiv Machine Learning →

arXiv:2606. 03338v1 Announce Type: new Abstract: Self-supervised learning (SSL) has emerged as a powerful paradigm for learning meaningful representations from unlabeled data.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 24

AdaDim: Dimensionality Adaptation for SSL Representational Dynamics

AdaDim introduces a training strategy for self‑supervised learning that adaptively balances dimensionality increase and mutual information reduction. By gradually regularizing the projection head while encouraging feature decorrelation and sample uniformity, AdaDim achieves up to 3% performance gains over standard SSL baselines without relying on costly techniques such as queues or predictor networks. The method demonstrates that optimal SSL models do not simply maximize dimensionality or minimize mutual information, but find a trade‑off between the two.

By Kiran Kokilepersaud, Mohit Prabhushankar, Ghassan AlRegib