The paper introduces Flow-Based Distribution Matching (FBDM), a non‑adversarial framework that learns self‑supervised representations using explicit geometric references and spherical conditional velocity regression. FBDM assigns augmented image views to shared target references while limiting reference usage, and employs an alignment loss to bring view representations closer. Experiments on datasets from CIFAR to ImageNet demonstrate that FBDM performs nearly as well as adversarial DM, outperforms existing SSL methods, and achieves a 1.48‑ to 1.83‑fold speedup with minimal GPU memory increase, while a theoretical analysis bounds downstream misclassification rates in terms of the pretraining loss.
By Yuling Jiao, Wensen Ma, Houduo Qi, Defeng Sun
The paper introduces Flow-Based Distribution Matching (FBDM), a non‑adversarial method that learns self‑supervised representations by aligning images to explicit geometric references through spherical conditional velocity regression. By using an ETF‑inspired reference, FBDM allows more reference components than the flow dimension while maintaining geometric separation, and it incorporates an alignment loss to bring augmented views closer together. Experiments on datasets from CIFAR to ImageNet show that FBDM performs nearly as well as adversarial distribution‑matching methods, achieves a 1.48‑ to 1.83‑fold speedup, and offers a theoretical bound on downstream misclassification rates.
arXiv:2607. 18072v1 Announce Type: cross Abstract: Generative models trained on a source domain often produce samples that are poorly aligned with shifted target domains, limiting their effectiveness for target-domain data augmentation.
By Jiaqi Zhu, Xincheng Chen, Yuncheng Wu, Zhaojing Luo, Beng Chin Ooi
arXiv:2608. 08309v1 Announce Type: cross Abstract: We argue that learning visual representations without labels requires a training signal jointly complete across three non-overlapping objectives: semantic invariance across augmented views, patch-level spatial prediction, and representational non-degeneracy.
By Nikos Giakoumoglou, Paschalis Giakoumoglou, Tania Stathaki
arXiv:2608. 03218v1 Announce Type: cross Abstract: Dataset distillation compresses a large training set into a compact synthetic set while retaining its downstream utility.
By Mingzhuo Li, Guang Li, Linfeng Ye, Jiafeng Mao, Takahiro Ogawa, Konstantinos N. Plataniotis, Miki Haseyama
arXiv:2609.24125v1 Announce Type: new
Abstract: Contrastive self-supervised learning has achieved strong performance by learning representations from multiple augmented views of the same image. Howev...
By Akshit Nanda, Shahzad Ahmad, Ram Prasad Padhy
arXiv:2602. 00797v2 Announce Type: replace-cross Abstract: Flow-based methods have achieved significant success in various generative modeling tasks, capturing nuanced details within complex data distributions.
By Yakun Wang, Leyang Wang, Song Liu, Taiji Suzuki
arXiv:2602.05391v3 Announce Type: replace
Abstract: Dataset distillation seeks to synthesize a compact surrogate dataset that enables performance comparable to training on the original dataset for do...
By Qianxin Xia, Jiawei Du, Yuhan Zhang, Xin Zhang, Xuewan He, Wenbo Jiang, Jielei Wang, Tao Luo, Guoming Lu
The paper introduces a flow matching framework that unifies various neural representational dissimilarity metrics under a single theoretical umbrella. By interpreting these metrics as Jeffreys divergences with different velocity constraints, the authors demonstrate that flow matching improves distance estimation for complex distributions and continuous variables. The framework also facilitates the principled design of new dissimilarity measures.
By Zeyuan Ye, Xue-Xin Wei
arXiv:2602. 23353v2 Announce Type: replace-cross Abstract: The Platonic Representation Hypothesis posits that neural networks trained on different modalities converge toward a shared statistical model of the world.
By Simon Roschmann, Paul Krzakala, Sonia Mazelet, Quentin Bouniot, Zeynep Akata
DGCPath is a Distribution‑Aware Generative Contrastive framework designed for self‑supervised path representation learning. It combines a diffusion‑based view generator, a variational contrastive mechanism that aligns latent features at the distribution level, and a generative cross‑supervision module for view‑level consistency. Experiments on three real‑world trajectory datasets show that DGCPath surpasses state‑of‑the‑art baselines on two downstream tasks, indicating stronger generalization and representation effectiveness.
By Sean Bin Yang, Hao Miao, Zongyi Xu, Jilin Hu, Xiangmeng Wang, Hua Lu, Bin Yang, Christian S. Jensen
The study investigates how the geometry of representations in artificial neural networks can be steered to improve bidirectional alignment with biological neural responses. By applying spectral regularization during training of self‑supervised contrastive vision models, the authors increased reverse predictivity by 55% while only modestly reducing forward predictivity. The changes also lowered effective dimensionality and reorganized the shared subspace, making forward and reverse predictivity more symmetric at certain spectral exponents.
By Samuel Kostousov, Abhinn Kaushik, Brokoslaw Laschowski